-- Logs begin at Wed 2022-08-31 09:00:50 UTC, end at Wed 2022-08-31 10:07:44 UTC. -- Aug 31 09:39:40.821055 dv-cinder-837543-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 09:39:40.831209 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 09:39:40 2022] *** Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: nodename: dv-cinder-837543-8-iscsi Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: machine: x86_64 Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: clock source: unix Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: pcre jit disabled Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: detected number of CPU cores: 4 Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: current working directory: / Aug 31 09:39:40.832765 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: detected binary path: /usr/bin/uwsgi-core Aug 31 09:39:40.833510 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: your processes number limit is 47680 Aug 31 09:39:40.833510 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: your memory page size is 4096 bytes Aug 31 09:39:40.833510 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: detected max file descriptor number: 2048 Aug 31 09:39:40.833510 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: lock engine: pthread robust mutexes Aug 31 09:39:40.833510 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: thunder lock: enabled Aug 31 09:39:40.833510 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 09:39:40.833510 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 09:39:40.871512 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: Python main interpreter initialized at 0x55d5b7fe79c0 Aug 31 09:39:40.871512 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: python threads support enabled Aug 31 09:39:40.871512 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: your server socket listen backlog is limited to 100 connections Aug 31 09:39:40.871512 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: your mercy for graceful operations on workers is 90 seconds Aug 31 09:39:40.871948 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 09:39:40.871948 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: *** Operational MODE: preforking *** Aug 31 09:39:40.872215 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: *** uWSGI is running in multiple interpreter mode *** Aug 31 09:39:40.872215 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: spawned uWSGI master process (pid: 117547) Aug 31 09:39:40.872433 dv-cinder-837543-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 09:39:40.873384 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: spawned uWSGI worker 1 (pid: 117548, cores: 1) Aug 31 09:39:40.873384 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: spawned uWSGI worker 2 (pid: 117549, cores: 1) Aug 31 09:39:40.873661 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 09:39:41.563793 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:39:41.578144 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:39:42.704324 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:39:42.704324 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: from cryptography.utils import int_from_bytes Aug 31 09:39:42.705138 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:39:42.705138 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: from cryptography.utils import int_from_bytes Aug 31 09:39:42.706404 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:39:42.706404 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: from cryptography.utils import int_from_bytes Aug 31 09:39:42.706842 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:39:42.706842 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: from cryptography.utils import int_from_bytes Aug 31 09:39:45.250685 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:39:45.251383 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:39:45.251612 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:39:45.251976 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:39:45.252228 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:39:45.252617 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.252940 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.253257 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.253571 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.253899 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.254211 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.254529 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.254846 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.255188 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.255445 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.255759 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.256081 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-8-iscsi {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.256406 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.256609 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:39:45.257000 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.257091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:39:45.257177 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.257305 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.257405 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:39:45.257608 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.257754 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:39:45.257934 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.258086 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:39:45.258241 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.258397 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.258720 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.258863 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.259023 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.259208 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.259370 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.259513 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.259699 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.260111 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.260317 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.260459 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.260593 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.260685 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.260892 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.261029 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.261225 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.261345 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.261484 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.261618 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.261800 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.261994 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.262131 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-8-iscsi {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.262277 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.262466 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.262652 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-8-iscsi {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.262801 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.262948 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.263092 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.263303 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.263432 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.263621 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.263810 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.263946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.264080 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.264221 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.264356 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.264497 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.264764 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.264927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.265070 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.265204 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.265346 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.265487 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.265662 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.265925 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.266108 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.266758 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.266905 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.267064 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.267344 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.267524 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.267662 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.267871 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.268010 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.268192 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.268314 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.268523 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.268672 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.268820 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.268962 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.269132 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.269266 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-8-iscsi {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.269416 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.269559 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.269707 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.269855 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.269991 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.270157 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.270313 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.270521 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.270678 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.270864 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.270996 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.271233 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.271363 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.271484 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.271608 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.271740 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.271916 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.272049 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.272169 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.272295 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.272420 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.272538 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.272736 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.272859 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.272986 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.273112 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.273294 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.273414 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.273598 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.273719 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.273906 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.274026 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.274216 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.274345 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.274536 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.274664 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.274839 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.274966 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.275161 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.275286 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.275426 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.275552 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.275708 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.275898 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.276060 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.276204 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.276321 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.276449 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.276641 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.276763 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.276890 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.277069 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.277225 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.277377 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.277513 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.277700 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.277833 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.278015 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.278135 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.278310 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.278431 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.278614 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.278748 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.278916 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.279034 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.279243 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.279376 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.279550 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.279763 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.279889 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.280020 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.280138 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.280263 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.280396 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.280531 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.280674 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.280793 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.280996 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.281139 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.281321 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.281461 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.281588 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.281706 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.282522 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.282660 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.282833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.283080 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.283246 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.283646 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.283767 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.283961 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.284092 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.284271 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.284395 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.284577 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.284706 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.284881 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.285011 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.285186 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.285307 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.285490 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.285611 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.285793 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.285927 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.286113 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.286245 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.286432 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.286562 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.286733 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.286853 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.287035 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.287231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.287362 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.287479 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.287609 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.287738 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.287915 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.288032 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.288237 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.288362 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.288542 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.288662 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.288849 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.288969 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.289151 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.289270 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.289451 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.289569 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.289758 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.289878 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.290059 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.290190 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.290363 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.290490 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.290670 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.290803 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.290966 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.291093 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.291343 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.291510 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.291640 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.291760 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.291893 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.292026 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.292178 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.292307 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.292479 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.292608 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.292779 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.292909 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.293097 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.293232 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.293350 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.293471 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.293652 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.293786 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.293952 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.294087 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.294247 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.294370 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.294561 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.294698 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.294866 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.294988 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.295195 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.295319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.295502 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.295637 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.295803 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.295961 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.296110 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.296237 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.296398 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.296528 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.296704 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.296831 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.297023 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.297151 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.297326 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.297466 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.297683 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.297870 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.298253 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.298384 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.298569 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.298690 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.298884 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.299004 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.299223 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.299345 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.299551 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.299672 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.299858 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.299977 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.300166 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.300288 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.300470 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.300590 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.300777 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.300898 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.301078 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.301209 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.301409 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.301600 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.301731 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.301870 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.302001 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.302134 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.302315 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.302443 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.302619 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.302750 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.302927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.303060 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:39:45.303271 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.303408 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.303590 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.303711 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.303900 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.304039 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.304241 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.304371 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.304597 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.304733 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.304881 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.305015 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.305198 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.305325 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.305513 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.305646 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.305821 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.305959 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.306129 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.306252 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.306437 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.306571 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.306746 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.306867 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.307057 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.307233 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.307397 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.307531 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.307714 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.307834 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.308027 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.308157 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.308352 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.308494 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.308654 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.308782 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.308961 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.309093 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.309267 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.309387 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.309572 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.309709 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.309883 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.310019 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.310246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.310396 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.310518 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.310637 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.310851 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.310987 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.311188 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.311330 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.311503 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.311633 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.311812 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.311932 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.312113 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.312250 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.312425 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.312544 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.312715 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.312835 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.313582 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.313736 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.313942 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.314125 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.314255 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.314565 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.314700 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.314835 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.314961 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.315190 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.315331 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.315493 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.315632 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.315802 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.315927 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.316134 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.316255 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.316441 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.316585 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.316748 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.316870 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.317056 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.317186 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.317365 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.317495 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.317669 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.317797 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.317982 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.318103 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.318289 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.318433 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.318594 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.318720 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.318910 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.319033 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.319279 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.319414 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.319546 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.319667 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.319838 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.319960 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.320142 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.320264 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.320445 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.320566 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.320751 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.320874 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.321054 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.321176 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.321359 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.321478 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.321664 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.321806 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.322022 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.322151 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.322287 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.322409 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.322566 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.322701 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.322874 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.323005 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.323226 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.323349 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.323540 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.323680 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.323927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.324068 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.324200 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.324357 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.324475 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.324616 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.324754 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.324876 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.325034 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.325168 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.325339 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.325473 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.325644 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.325822 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.325952 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.326073 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.326236 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.326357 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.326544 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.326679 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.326843 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.326965 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.327165 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.327290 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.327472 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.327592 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.327782 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.327902 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.328083 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.328204 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.328392 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.328513 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.329307 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.329589 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.329727 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.329903 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.330067 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.330190 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.330414 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.330557 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.330758 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.330915 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.331085 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.331265 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.331443 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.331650 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.331769 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.331905 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.332072 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.332217 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.332396 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.332530 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.332708 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.332829 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.333014 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.333143 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.333320 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.333458 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.333624 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.333743 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.333921 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.334040 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.334223 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.334345 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.334529 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.334649 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.334831 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.334951 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.335155 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.335300 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.335465 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.335597 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.335771 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.335890 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.336072 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.336199 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.336377 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.336498 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.336690 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.336815 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.336991 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.337122 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.337293 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.337415 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.337597 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.337730 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.337944 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.338065 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.338251 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.338370 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.338563 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.338695 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.338873 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.338998 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.339210 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.339335 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.339521 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.339664 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.339829 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.339951 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.340145 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.340280 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.340452 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.340587 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.340762 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.340892 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.341064 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.341184 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.341374 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.341508 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.341677 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.341796 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.341995 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.342310 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.342431 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.342586 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.342708 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.342911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.343041 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.343232 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.343352 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.343548 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.343669 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.343885 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.344076 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.344209 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.344338 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.344508 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.344628 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.344819 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.345128 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.345260 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.345430 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.345552 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.345733 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.345854 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.346040 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.346163 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.346352 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.346482 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.346658 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.346823 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.346955 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.347076 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.347289 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.347433 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.347599 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.347719 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.347911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.348042 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.348213 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.348346 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.348516 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.348637 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.348830 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.348971 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.349144 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.349275 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.349452 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.349587 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.349769 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.349889 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.350073 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.350203 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.350377 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.350510 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.350680 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.350813 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.350999 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.351186 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.351330 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.351472 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.351637 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.351787 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.351937 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.352072 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.352241 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.352382 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.352555 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.352678 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.352865 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.352999 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.353164 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.353283 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.353466 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.353597 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.353775 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.353906 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.354081 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.354235 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.354386 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.354517 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.354689 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.354820 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.354991 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.355145 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.355331 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.355453 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.355639 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.355761 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.355942 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.356064 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.356247 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.356368 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.356552 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.356686 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.356860 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.356985 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.357164 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.357287 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.357483 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.357616 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.357793 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.357934 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.358138 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.358302 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.358432 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.358565 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.358697 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.358817 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.358978 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.359147 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.359320 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.359459 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.359627 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.359947 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.360072 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.360285 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.360517 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.360781 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.360930 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.361116 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.361248 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.361440 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.361575 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.361790 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.361926 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.362125 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.362307 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.362455 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.362630 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.362769 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.362890 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.363059 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.363240 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.363395 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.363516 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.363701 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.363824 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.364004 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.364126 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.364317 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.364445 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.364615 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.364736 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.364917 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.365038 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.365220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.365342 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.365527 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.365659 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.365831 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.365951 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.366132 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.366266 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.366432 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.366553 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.366735 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.366963 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.367095 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.367256 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.367377 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.367499 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.367655 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.367932 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.368056 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.368264 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.368387 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.368567 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.368687 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.368869 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.369007 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.369194 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.369326 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.369459 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.369580 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.369784 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.369919 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.370087 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.370223 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.370421 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.370543 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.370746 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.370866 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.371060 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.371236 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.371391 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.371514 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.371698 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.371820 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.372009 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.372130 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.372325 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.372464 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.372627 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.372803 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.372935 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.373063 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.373220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.373342 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.373522 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.373657 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.373820 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.373940 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.374121 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.374240 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.374429 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.374581 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.374730 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.374849 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.375032 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.375204 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.375356 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.376023 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.376254 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.376391 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.376740 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.376861 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.377059 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.377202 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.377365 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.377488 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.377669 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.377791 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.377978 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.378113 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.378288 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.378412 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.378593 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.378715 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.378895 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.379041 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.379249 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.379390 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.379511 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.379730 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.379864 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.380040 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.380162 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.380349 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.380472 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.380676 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.380817 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.380980 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.381099 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.381283 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.381404 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.381583 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.381715 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.381892 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.382013 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.382201 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.382343 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.382513 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.382641 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.382816 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.382988 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.383116 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.383271 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.383434 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.383565 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.383737 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.383859 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.384040 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.384161 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.384350 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.384481 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.384659 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.384793 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.385216 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.385337 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.385552 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.385672 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.385799 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.385935 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.386103 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.386238 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.386406 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.386543 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.386729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.386866 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.386993 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.387216 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.387339 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.387479 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.387611 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.387731 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.387904 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.388039 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.388205 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.388335 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.388505 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.388627 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.388809 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.388943 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.389107 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.389236 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.389414 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.389547 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.389711 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.389832 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.390036 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.390157 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.390337 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.390469 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.390640 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.390761 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.390944 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.391066 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.391832 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.392027 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.392271 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.392397 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.392585 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.392821 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.392956 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.393145 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.393279 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.393460 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.393593 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.393774 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.393895 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.394078 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.394223 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.394386 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.394517 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.394693 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.394822 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.394989 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.395110 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.395319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.395457 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.395629 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.395769 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.395933 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.396056 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.396236 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.396358 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.396540 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.396664 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.396845 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.396967 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.397152 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.397275 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.397459 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.397592 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.397770 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.397891 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.398072 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.398195 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.398408 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.398550 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.398671 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.398793 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.398975 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.399095 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.399310 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.399452 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.399657 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.399787 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.399932 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.400054 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.400241 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.400377 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.400548 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.400671 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.400854 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.400977 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.401160 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.401295 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.401464 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.401587 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.401765 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.401885 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.402078 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.402199 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.402382 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.402504 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.402690 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.402875 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.403009 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.403199 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.403325 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.403452 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.403597 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.403719 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.403907 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.404028 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.404218 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.404339 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.404541 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.404675 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.404869 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.405021 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.405189 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.405322 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.405493 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.405628 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.405799 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.405921 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.406106 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.406238 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.406408 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.406540 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.406716 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.406876 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.407052 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.407225 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.407498 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.407622 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.407819 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.408116 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.408237 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.408419 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.408540 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.408727 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.408850 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.409039 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.409160 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.409340 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.409484 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.409647 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.409777 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.409945 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.410067 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.410249 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.410382 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.410557 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.410677 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.410870 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.410990 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.411203 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.411322 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.411515 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.411646 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.411816 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.411951 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.412126 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.412292 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.412437 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.412600 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.412876 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.413060 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.413193 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.413315 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.413484 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.413624 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.413787 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.413909 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.414096 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.414217 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.414407 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.414539 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.414712 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.414832 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.415072 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.415210 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.415354 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.415476 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.415679 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.415799 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.415989 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.416112 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.416292 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.416425 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.416611 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.416750 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.416922 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.417043 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.417227 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.417350 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.417536 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.417694 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.417859 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.418000 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.418162 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.418286 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.418466 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.418589 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.418769 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.418903 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.419092 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.419298 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.419442 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.419572 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.419731 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.419918 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.420064 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.420185 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.420367 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.420490 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.420671 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.420812 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.420991 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.421137 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.421294 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.421446 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.421603 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.421756 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.421913 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.422078 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.422213 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.422463 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.422600 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.422843 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.422965 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.423195 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.423324 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.423502 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.423650 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.423820 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.423943 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.424133 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.424264 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.424440 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.424573 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.424763 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.424885 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.425071 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.425218 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.425424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.425546 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.425680 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.425800 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.425969 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.426091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.426271 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.426392 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.426571 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.426695 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.426912 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.427060 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.427231 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.427412 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.427536 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.427723 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.427846 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.428046 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.428180 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.428375 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.428497 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.428665 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.428784 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.428974 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.429097 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.429284 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.429440 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.429573 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.429693 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.429884 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.430063 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.430193 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.430325 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.430496 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.430619 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.430807 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.430993 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.431196 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.431317 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.431463 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.431583 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.431718 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.431840 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.432017 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.432151 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.432321 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.432464 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.432622 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.432745 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.432921 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.433053 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.433245 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.433395 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.433540 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.433720 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.433997 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.434116 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.434244 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.434378 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.434500 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.434621 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.434742 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.434863 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.434998 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.435218 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.435356 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.435480 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.435636 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.435760 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.435960 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.436084 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.436265 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.436387 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.436586 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.436708 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.436897 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.437018 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.437210 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.437335 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.437527 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.437649 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.437838 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.438479 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.438698 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.438838 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.439163 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.439289 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.439526 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.439772 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.439906 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.440115 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.440252 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.440424 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.440547 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.440736 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.440869 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.441052 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.441357 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.441491 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.441666 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.441787 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.441974 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.442097 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.442293 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.442427 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.442598 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.442721 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.442906 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.443027 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.443244 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.443435 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.443556 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.443681 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.443856 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.443998 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.444165 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.444316 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.444500 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.444636 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.444803 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.444926 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.445107 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.445230 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.445418 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.445559 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.445759 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.445882 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.446064 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.446188 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.446379 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.446499 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.446691 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.446824 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.447001 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.447160 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.447328 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.447446 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.447649 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.447789 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.447968 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.448093 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.448278 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.448399 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.448636 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.448766 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.448888 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.449008 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.449202 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.449324 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.449509 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.449639 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.449818 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.449940 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.450129 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.450308 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.450448 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.450570 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.450732 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.450988 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.451181 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.451341 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.451490 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.451658 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.451780 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.451974 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.452100 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.452292 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.452416 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.452606 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.452742 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.452920 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.453044 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.453232 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.453366 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.453547 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.454566 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.454700 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.454953 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.455152 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.455323 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.455554 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.455684 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.455882 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.456090 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.456222 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.456357 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.456542 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.456667 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.456866 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.457001 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.457187 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.457312 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.457497 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.457627 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.457812 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.457969 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.458128 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.458249 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.458438 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.458573 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.458756 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.458888 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.459066 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.459226 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.459395 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.459528 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.459715 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.459836 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.460024 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.460147 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.460339 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.460561 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.460696 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.460912 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.461036 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.461302 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.461474 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.461606 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.461740 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.461865 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.461997 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.462155 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.462279 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.462460 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.462591 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.462783 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.462905 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.463087 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.463284 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.463422 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.463543 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.463722 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.463852 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.464029 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.464153 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.464333 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.464567 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.464696 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.464883 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.465017 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.465222 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.465395 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.465517 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.465702 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.465838 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.465971 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.466111 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.466336 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.466460 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.466584 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.466749 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.466961 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.467096 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.467284 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.467405 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.467529 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.467692 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.467934 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.468074 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.468194 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.468319 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.468442 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.468564 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.468698 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.468820 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.468947 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.469074 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.469194 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.470003 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.470138 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.470351 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.470626 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.470756 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.470969 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.471297 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.471440 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.471609 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.471733 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.471964 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.472087 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.472292 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.472427 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.472601 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.472734 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.472907 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.473030 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.473228 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.473433 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.473598 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.473721 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.473871 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.473997 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.474184 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.474314 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.474489 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.474621 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.474817 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.474944 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.475165 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.475290 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.475455 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.475716 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.475900 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.476046 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.476190 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.476358 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.476491 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.476670 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.476794 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.476974 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.477097 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.477298 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.477450 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.477605 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.477725 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.477909 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.478045 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.478212 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.478343 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.478522 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.478644 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.478826 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.478946 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.479142 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.479264 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.479453 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.479591 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.479757 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.479880 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.480063 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.480188 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.480366 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.480500 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.480673 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.480801 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.480972 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.481103 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.481274 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.481408 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.481575 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.481695 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.481878 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.482001 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.482184 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.482317 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.482488 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.482609 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.482800 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.482925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.483155 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.483283 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.483465 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.483586 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.483773 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.483908 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.484083 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.484206 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.484394 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.484532 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.484720 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.484931 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.485960 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.486508 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.487315 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.487483 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.487622 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.487758 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.487964 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.488082 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.488204 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.488328 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.488450 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.488585 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.488745 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.488872 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.489055 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.489177 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.489367 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.489593 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.489716 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.489911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.490032 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.490233 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.490359 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.490679 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.490872 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.490999 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.491207 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.491346 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.491510 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.491635 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.491823 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.491946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.492136 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.492270 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.492445 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.492566 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.492753 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.492886 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.493068 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.493211 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.493381 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.493504 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.493693 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.493816 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.494007 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.494180 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.494300 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.494424 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.494604 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.494726 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.494912 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.495035 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.495256 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.495381 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.495568 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.495703 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.495875 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.496007 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.496180 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.496302 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.496488 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.496621 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.496789 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.496910 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.497095 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.497217 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.497401 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.497546 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.497723 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.497852 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.497998 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.498121 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.498287 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.498424 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.498588 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.498734 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.498890 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.499046 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.499205 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.499392 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.499516 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.499712 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.499834 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.500022 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.500157 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.500344 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.500506 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.500718 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.500844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.501024 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.501293 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.501524 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.501652 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.501776 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.501952 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.502074 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.502284 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.502408 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.502626 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.502747 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.502954 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.503105 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.503395 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.503518 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.503648 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.503782 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.503914 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.504045 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.504164 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.504286 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.504479 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.504621 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.504800 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.504935 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.505104 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.505237 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.505407 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.505531 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.505712 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.505847 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.506021 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.506143 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.506326 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.506460 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.506632 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.506768 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.506938 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.507073 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.507269 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.507408 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.507595 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.507717 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.507891 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.508012 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.508146 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.508265 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.508448 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.508571 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.508750 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.508873 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.509053 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.509201 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.509359 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.509482 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.509666 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.509788 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.510230 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.510365 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.510533 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.510656 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.510834 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.510968 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.511154 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.511304 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.511459 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.511583 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.511776 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.511896 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.512089 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.512224 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.512398 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.512521 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.512709 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.512841 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.513021 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.513142 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.513332 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.513454 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.513638 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.513759 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.513959 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.514091 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.514269 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.514440 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.514581 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.514704 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.514888 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.515011 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.515247 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.515374 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.515557 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.515679 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.515866 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.515998 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.516257 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.516437 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.516560 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.516942 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.517082 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.517216 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.517336 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.517461 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117549) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:39:45.517593 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.517927 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.518252 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.518562 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.518892 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.519240 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.519566 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.519885 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.520200 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.521447 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.521447 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.521447 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.521447 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.521947 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.522070 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.522329 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.522637 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.522950 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.523302 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.523623 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.523949 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.524276 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.524589 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.524917 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.525242 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.525593 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.525905 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.526254 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.526583 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.526899 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.527239 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.527548 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:39:45.527797 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:39:45.676019 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO dbcounter [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Registered counter for database nova_api Aug 31 09:39:45.688642 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO dbcounter [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Registered counter for database nova_api Aug 31 09:39:45.696739 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_db.sqlalchemy.engines [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:45.703500 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writer thread running {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:45.709787 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_db.sqlalchemy.engines [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:45.720809 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writer thread running {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:45.760810 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.context [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2892fd19-82dd-46bd-9aca-c75fabb94ea6(cell1) {{(pid=117549) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:39:45.764706 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:39:45.765171 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:39:45.767600 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:39:45.768586 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:39:45.768762 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:39:45.770769 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:39:45.772791 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO dbcounter [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Registered counter for database nova_cell0 Aug 31 09:39:45.776911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO dbcounter [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Registered counter for database nova_cell1 Aug 31 09:39:45.784648 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.context [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2892fd19-82dd-46bd-9aca-c75fabb94ea6(cell1) {{(pid=117548) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:39:45.785405 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_db.sqlalchemy.engines [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:45.787711 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_db.sqlalchemy.engines [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:45.788630 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:39:45.789103 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:39:45.790695 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:39:45.791464 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:39:45.791909 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:39:45.793917 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_concurrency.lockutils [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:39:45.794546 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writer thread running {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:45.795935 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO dbcounter [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Registered counter for database nova_cell0 Aug 31 09:39:45.796080 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writer thread running {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:45.801276 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO dbcounter [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Registered counter for database nova_cell1 Aug 31 09:39:45.808775 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_db.sqlalchemy.engines [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:45.812215 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_db.sqlalchemy.engines [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:45.816723 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writer thread running {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:45.942976 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO dbcounter [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Registered counter for database nova_cell0 Aug 31 09:39:45.950301 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_db.sqlalchemy.engines [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117549) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:45.955955 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writer thread running {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:45.960869 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writer thread running {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:45.972380 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO dbcounter [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Registered counter for database nova_cell0 Aug 31 09:39:45.983695 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG oslo_db.sqlalchemy.engines [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:39:45.990198 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writer thread running {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:39:46.306608 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: WARNING keystonemiddleware.auth_token [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:39:46.313974 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: WARNING keystonemiddleware.auth_token [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:39:46.315883 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: WARNING keystonemiddleware.auth_token [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:39:46.323132 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: WARNING keystonemiddleware.auth_token [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:39:46.660470 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: WARNING keystonemiddleware.auth_token [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:39:46.666346 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: WARNING keystonemiddleware.auth_token [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:39:46.668987 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: WARNING keystonemiddleware.auth_token [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:39:46.671655 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5b7fe79c0 pid: 117549 (default app) Aug 31 09:39:46.673820 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:39:46.674926 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: WARNING keystonemiddleware.auth_token [None req-63e3c8fe-47d8-460a-b6a6-05ccc17f77b4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:39:46.675025 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001785 Aug 31 09:39:46.675773 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Wed Aug 31 09:39:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:39:46.680432 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5b7fe79c0 pid: 117548 (default app) Aug 31 09:41:12.072676 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:12.074300 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002422 Aug 31 09:41:12.078653 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:12.090706 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:12.092352 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:12.093448 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell1:SELECT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:12.094493 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_cell0:SELECT=3 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:13.198036 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d71c13d7-3e89-438e-bd97-5e72f57a8120 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:13.237667 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d71c13d7-3e89-438e-bd97-5e72f57a8120 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.151560 Aug 31 09:41:13.239000 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Aug 31 09:41:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:15.789961 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:15.792181 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-1b7a7bcf-8f10-4500-ab46-2a85f49047c1 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003364 Aug 31 09:41:15.793068 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:16.389317 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-078450c8-3ca1-42f7-9d11-ced417deb6a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "ram": 256, "rxtx_factor": 1.0}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:16.445282 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-078450c8-3ca1-42f7-9d11-ced417deb6a1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.644522 Aug 31 09:41:16.454630 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:16.462913 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_api:SELECT=3 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:16.464193 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_cell1:SELECT=3 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:16.465286 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_cell0:SELECT=3 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:16.466907 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:16.702286 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-7adf2145-d871-423f-a43e-69e21f3a3ad0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:16.772855 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-7adf2145-d871-423f-a43e-69e21f3a3ad0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.316886 Aug 31 09:41:16.773696 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 09:41:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:19.187526 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-078450c8-3ca1-42f7-9d11-ced417deb6a1 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:19.188536 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-078450c8-3ca1-42f7-9d11-ced417deb6a1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 31 09:41:19.188930 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:41:19.930615 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-224b52bc-70fb-4b03-a0f3-77a52e7cca9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1"}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:19.974215 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-224b52bc-70fb-4b03-a0f3-77a52e7cca9f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.778667 Aug 31 09:41:19.974808 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:19.987656 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-e35775fe-5c24-432e-880c-77e151a836d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:20.035807 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-e35775fe-5c24-432e-880c-77e151a836d9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052279 Aug 31 09:41:20.036432 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 09:41:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:41:22.505578 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-224b52bc-70fb-4b03-a0f3-77a52e7cca9f admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:22.507055 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-224b52bc-70fb-4b03-a0f3-77a52e7cca9f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Aug 31 09:41:22.507894 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:22.990197 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-708a6e59-1699-4795-8bff-dc4e563c039f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "disk": 10, "swap": 0, "id": "d2", "ram": 1024}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:23.011173 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-708a6e59-1699-4795-8bff-dc4e563c039f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495604 Aug 31 09:41:23.011727 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:41:23.026137 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-4019ee2f-dff7-4346-a10c-e802a371c8fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:23.055995 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-4019ee2f-dff7-4346-a10c-e802a371c8fa admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034366 Aug 31 09:41:23.056576 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 09:41:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:25.480704 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-708a6e59-1699-4795-8bff-dc4e563c039f admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:25.482742 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-708a6e59-1699-4795-8bff-dc4e563c039f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002738 Aug 31 09:41:25.483178 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:26.025623 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-89ac2479-c8b3-4e47-9b35-e886747b7374 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3"}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:26.047530 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-89ac2479-c8b3-4e47-9b35-e886747b7374 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.557686 Aug 31 09:41:26.048103 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:26.061507 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dcbb1140-c514-429c-84f6-5a21a9a2d90b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:26.094874 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dcbb1140-c514-429c-84f6-5a21a9a2d90b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037622 Aug 31 09:41:26.095879 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 09:41:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:28.572136 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-89ac2479-c8b3-4e47-9b35-e886747b7374 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:28.573985 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-89ac2479-c8b3-4e47-9b35-e886747b7374 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002344 Aug 31 09:41:28.574424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:29.102223 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-51eb06e5-a0b0-47cc-92d2-cc3caa91fdc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:29.123289 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-51eb06e5-a0b0-47cc-92d2-cc3caa91fdc7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.540385 Aug 31 09:41:29.124496 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:29.136581 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-1d034d6d-a152-4d7c-9ef7-a82b1ff35547 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:29.161721 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-1d034d6d-a152-4d7c-9ef7-a82b1ff35547 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028986 Aug 31 09:41:29.167487 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Aug 31 09:41:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:31.591565 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-51eb06e5-a0b0-47cc-92d2-cc3caa91fdc7 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:31.592601 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-51eb06e5-a0b0-47cc-92d2-cc3caa91fdc7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002493 Aug 31 09:41:31.593095 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:32.149159 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-c3f7bd7f-ec37-4768-9cfe-f46a2399a5ef admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:32.180401 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-c3f7bd7f-ec37-4768-9cfe-f46a2399a5ef admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.580894 Aug 31 09:41:32.180952 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Aug 31 09:41:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:41:35.110983 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-51eb06e5-a0b0-47cc-92d2-cc3caa91fdc7 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:35.112515 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-51eb06e5-a0b0-47cc-92d2-cc3caa91fdc7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Aug 31 09:41:35.112999 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:35.588477 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-1a005947-365b-4a38-8efb-a4f9b75b1abf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "id": "1", "disk": 1}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:35.609825 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-1a005947-365b-4a38-8efb-a4f9b75b1abf admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.490272 Aug 31 09:41:35.610392 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:35.623778 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0d0fd5bf-624f-4e0f-aa26-709ad1a3040d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:35.648564 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0d0fd5bf-624f-4e0f-aa26-709ad1a3040d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029437 Aug 31 09:41:35.649362 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 09:41:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:41:38.080455 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-1a005947-365b-4a38-8efb-a4f9b75b1abf admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:38.081487 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-1a005947-365b-4a38-8efb-a4f9b75b1abf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 31 09:41:38.081885 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:38.469922 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c944bc1d-b891-4657-9cf9-cb6951f90e0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "rxtx_factor": 1.0, "disk": 20, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:38.488958 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c944bc1d-b891-4657-9cf9-cb6951f90e0d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.400773 Aug 31 09:41:38.489524 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:41:38.502151 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-e498c99c-96be-433b-a32c-c2f9687611f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:38.528981 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-e498c99c-96be-433b-a32c-c2f9687611f0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029375 Aug 31 09:41:38.529569 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 09:41:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:40.976871 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c944bc1d-b891-4657-9cf9-cb6951f90e0d admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:40.977885 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c944bc1d-b891-4657-9cf9-cb6951f90e0d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 31 09:41:40.978286 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:41.491016 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-22ed79b4-1f95-4615-9130-08d4a6fe36dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "rxtx_factor": 1.0}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:41.518490 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-22ed79b4-1f95-4615-9130-08d4a6fe36dd admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.532724 Aug 31 09:41:41.519286 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:41.533422 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-ff27627f-a73a-4148-8d65-681c804a0a20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:41.561294 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-ff27627f-a73a-4148-8d65-681c804a0a20 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031483 Aug 31 09:41:41.561874 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 09:41:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:43.991464 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-22ed79b4-1f95-4615-9130-08d4a6fe36dd admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:43.992892 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-22ed79b4-1f95-4615-9130-08d4a6fe36dd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002085 Aug 31 09:41:43.993545 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:44.459955 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-994c012d-d909-4a71-8d3c-ca9944669cc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 80, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "id": "4"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:44.468678 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:44.484079 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-994c012d-d909-4a71-8d3c-ca9944669cc5 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.483854 Aug 31 09:41:44.486119 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:44.498628 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-902b965e-9d75-471a-a50a-9ea39a16f946 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:44.526268 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-902b965e-9d75-471a-a50a-9ea39a16f946 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031170 Aug 31 09:41:44.526864 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 09:41:44 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:41:47.022998 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-994c012d-d909-4a71-8d3c-ca9944669cc5 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:41:47.024677 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-994c012d-d909-4a71-8d3c-ca9944669cc5 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Aug 31 09:41:47.025301 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:41:47.524993 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-fe052d76-0ffd-4b06-8913-ed5287c23937 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:47.535497 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:47.572513 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-fe052d76-0ffd-4b06-8913-ed5287c23937 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.540530 Aug 31 09:41:47.573098 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Aug 31 09:41:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:41:47.587013 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7967dc44-7df0-42b3-bf8d-7c8df813c69a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:41:47.616129 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7967dc44-7df0-42b3-bf8d-7c8df813c69a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032588 Aug 31 09:41:47.616871 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Aug 31 09:41:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:42:05.876732 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-fe052d76-0ffd-4b06-8913-ed5287c23937 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:05.877820 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-fe052d76-0ffd-4b06-8913-ed5287c23937 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Aug 31 09:42:05.878300 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:05.890288 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:42:06.307172 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-c8eaf6ca-5d4b-4552-b729-b2250e656e64 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:06.326393 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-c8eaf6ca-5d4b-4552-b729-b2250e656e64 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.441108 Aug 31 09:42:06.326938 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Aug 31 09:42:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:42:07.433119 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-fe052d76-0ffd-4b06-8913-ed5287c23937 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:07.434810 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-fe052d76-0ffd-4b06-8913-ed5287c23937 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002084 Aug 31 09:42:07.435201 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:42:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:07.968726 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2b298170-6cb2-436f-8c62-e9aa188abc64 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:07.974451 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-2b298170-6cb2-436f-8c62-e9aa188abc64 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2b298170-6cb2-436f-8c62-e9aa188abc64 admin admin] Request method failure captured: Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Accept: application/json Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Accept-Encoding: gzip, deflate Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Connection: keep-alive Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Content-Length: 0 Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Openstack-Api-Version: compute 2.90 Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: User-Agent: python-novaclient Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABjDyzv8aaiB6mq_BH_gujGQ_UwS1n3xWVhNWB4PWNW1HFDU2OYSOxjX6u78w4BRyolSUxZ-3H-WJfohNPvWHX-lM9hzWj5u4F5Hv8Nz-VNAiLix3CFlp6jrgGEmGxdqPNJ_Ad_QPKbwo-WIt7UYEZiffgx83veQRz9pm8y18qFzU6TkyU Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Name: admin Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Role: reader,member,admin Aug 31 09:42:07.977766 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Roles: reader,member,admin Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Tenant: admin Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Tenant-Name: admin Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User: admin Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Id: d7063e9478d747e983e7ced895545d44 Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Name: admin Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: method: > Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: exception: Flavor 42 could not be found. Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: action_args: {'id': '42'} Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:42:07.979319 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:07.983844 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:07.985159 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-2b298170-6cb2-436f-8c62-e9aa188abc64 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:42:07.986425 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-2b298170-6cb2-436f-8c62-e9aa188abc64 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.407161 Aug 31 09:42:07.986425 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Aug 31 09:42:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:42:07.989674 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-8a729a07-b226-49e3-8e8b-b75799489083 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:08.015638 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-8a729a07-b226-49e3-8e8b-b75799489083 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029350 Aug 31 09:42:08.016198 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 09:42:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:42:08.026015 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-484191ac-1924-42b3-bb9b-257a2ade349f admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:08.049518 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-484191ac-1924-42b3-bb9b-257a2ade349f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026979 Aug 31 09:42:08.050061 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 09:42:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:42:08.061203 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-c434c645-4ce0-4a34-8fa9-c5bb8a33346e admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:08.067232 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.wsgi [None req-c434c645-4ce0-4a34-8fa9-c5bb8a33346e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-c434c645-4ce0-4a34-8fa9-c5bb8a33346e admin admin] Request method failure captured: Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Accept: application/json Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Accept-Encoding: gzip, deflate Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Connection: keep-alive Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Content-Length: 0 Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Host: 10.222.0.36 Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Openstack-Api-Version: compute 2.90 Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Openstack-System-Scope: None Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: User-Agent: python-novaclient Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Auth-Token: gAAAAABjDyzv8aaiB6mq_BH_gujGQ_UwS1n3xWVhNWB4PWNW1HFDU2OYSOxjX6u78w4BRyolSUxZ-3H-WJfohNPvWHX-lM9hzWj5u4F5Hv8Nz-VNAiLix3CFlp6jrgGEmGxdqPNJ_Ad_QPKbwo-WIt7UYEZiffgx83veQRz9pm8y18qFzU6TkyU Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Domain-Id: None Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Domain-Name: None Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Identity-Status: Confirmed Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Is-Admin-Project: True Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Domain-Id: default Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Domain-Name: Default Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Name: admin Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Role: reader,member,admin Aug 31 09:42:08.070475 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Roles: reader,member,admin Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Tenant: admin Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Tenant-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Tenant-Name: admin Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User: admin Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Domain-Id: default Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Domain-Name: Default Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Id: d7063e9478d747e983e7ced895545d44 Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Name: admin Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: method: > Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: exception: Flavor 42 could not be found. Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: action_args: {'id': '42'} Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:42:08.071946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:08.072805 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:08.073833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-c434c645-4ce0-4a34-8fa9-c5bb8a33346e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:42:08.075817 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-c434c645-4ce0-4a34-8fa9-c5bb8a33346e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015806 Aug 31 09:42:08.075817 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Aug 31 09:42:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:42:09.080642 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-484191ac-1924-42b3-bb9b-257a2ade349f admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:09.081704 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-484191ac-1924-42b3-bb9b-257a2ade349f admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 31 09:42:09.082050 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:42:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:09.623753 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-df2324c7-025b-47d2-b88a-d7231e687e81 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:09.629691 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.wsgi [None req-df2324c7-025b-47d2-b88a-d7231e687e81 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-df2324c7-025b-47d2-b88a-d7231e687e81 admin admin] Request method failure captured: Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Accept: application/json Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Accept-Encoding: gzip, deflate Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Connection: keep-alive Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Content-Length: 0 Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Host: 10.222.0.36 Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Openstack-Api-Version: compute 2.90 Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Openstack-System-Scope: None Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: User-Agent: python-novaclient Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Auth-Token: gAAAAABjDyzwX-0rzU0DnNMtQ3zzqQMGXACfccfBQysZ3qnYeU0AbJRfKoXaIlgjIbgn0h1o6YNTmhp_WlIgxohvW7_7Rs6zCbRyvrkc6RrNBgt2Ymv_G_eiZ0xmdnbOfwScPLOab_H2XVjgzdilKuKS2j3CdkVw7Ft_6j5DprNq1H3Xe4HxVyE Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Domain-Id: None Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Domain-Name: None Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Identity-Status: Confirmed Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Is-Admin-Project: True Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Domain-Id: default Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Domain-Name: Default Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Name: admin Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Role: reader,member,admin Aug 31 09:42:09.631220 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Roles: reader,member,admin Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Tenant: admin Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Tenant-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Tenant-Name: admin Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User: admin Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Domain-Id: default Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Domain-Name: Default Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Id: d7063e9478d747e983e7ced895545d44 Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Name: admin Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: method: > Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: exception: Flavor 84 could not be found. Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: action_args: {'id': '84'} Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:42:09.632911 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:09.633828 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.635424 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-df2324c7-025b-47d2-b88a-d7231e687e81 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:42:09.637479 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-df2324c7-025b-47d2-b88a-d7231e687e81 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.410448 Aug 31 09:42:09.637479 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Aug 31 09:42:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:42:09.643390 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-dafb7f48-7062-46b7-80f6-848b49169ad5 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:09.658414 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-dafb7f48-7062-46b7-80f6-848b49169ad5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018593 Aug 31 09:42:09.658965 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 09:42:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:42:09.669354 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-3e54638d-e9b3-44c3-8561-6a7c8dff8490 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:09.685149 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-3e54638d-e9b3-44c3-8561-6a7c8dff8490 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019906 Aug 31 09:42:09.685690 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 09:42:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:42:09.695017 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9969257e-bf7e-491e-99a6-e2bd16807ad1 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:09.702985 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-9969257e-bf7e-491e-99a6-e2bd16807ad1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9969257e-bf7e-491e-99a6-e2bd16807ad1 admin admin] Request method failure captured: Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Accept: application/json Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Accept-Encoding: gzip, deflate Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Connection: keep-alive Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Content-Length: 0 Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Openstack-Api-Version: compute 2.90 Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: User-Agent: python-novaclient Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABjDyzwX-0rzU0DnNMtQ3zzqQMGXACfccfBQysZ3qnYeU0AbJRfKoXaIlgjIbgn0h1o6YNTmhp_WlIgxohvW7_7Rs6zCbRyvrkc6RrNBgt2Ymv_G_eiZ0xmdnbOfwScPLOab_H2XVjgzdilKuKS2j3CdkVw7Ft_6j5DprNq1H3Xe4HxVyE Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Name: admin Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Role: reader,member,admin Aug 31 09:42:09.704579 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Roles: reader,member,admin Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Tenant: admin Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Tenant-Name: admin Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User: admin Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Id: d7063e9478d747e983e7ced895545d44 Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Name: admin Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: method: > Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: exception: Flavor 84 could not be found. Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: action_args: {'id': '84'} Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:42:09.706729 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:09.707925 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:09.709246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-9969257e-bf7e-491e-99a6-e2bd16807ad1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:42:09.710463 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-9969257e-bf7e-491e-99a6-e2bd16807ad1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014540 Aug 31 09:42:09.710463 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Aug 31 09:42:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 09:42:10.693271 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-3e54638d-e9b3-44c3-8561-6a7c8dff8490 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:10.694305 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-3e54638d-e9b3-44c3-8561-6a7c8dff8490 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Aug 31 09:42:10.694704 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:11.241659 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a566ccb6-08a2-400a-92e4-341381923ef9 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:11.248044 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.wsgi [None req-a566ccb6-08a2-400a-92e4-341381923ef9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a566ccb6-08a2-400a-92e4-341381923ef9 admin admin] Request method failure captured: Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Accept: application/json Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Accept-Encoding: gzip, deflate Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Connection: keep-alive Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Content-Length: 0 Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Host: 10.222.0.36 Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Openstack-Api-Version: compute 2.90 Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Openstack-System-Scope: None Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: User-Agent: python-novaclient Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Auth-Token: gAAAAABjDyzy-HjK2IYLVgGGJpUO4pOGKi1DSqZQQfKJpDJy-BHTODaVl9dLTs7ZqVqs5KltVyDep6WyB6NJNS6_utai2F-NreStMuCchVVhFEri6rEt4YgJu9vVn_uE4d6PnCjCOjC3rNQdrfXsQ8Ydxo3LU-WCCwOaNgzYegR_HVOmMVQMAO8 Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Domain-Id: None Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Domain-Name: None Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Identity-Status: Confirmed Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Is-Admin-Project: True Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Domain-Id: default Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Domain-Name: Default Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Project-Name: admin Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Role: reader,member,admin Aug 31 09:42:11.249539 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Roles: reader,member,admin Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Tenant: admin Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Tenant-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-Tenant-Name: admin Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User: admin Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Domain-Id: default Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Domain-Name: Default Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Id: d7063e9478d747e983e7ced895545d44 Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: X-User-Name: admin Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: method: > Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: exception: Flavor 451 could not be found. Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: action_args: {'id': '451'} Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:42:11.251231 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:11.252091 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.253140 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-a566ccb6-08a2-400a-92e4-341381923ef9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:42:11.254236 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-a566ccb6-08a2-400a-92e4-341381923ef9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.414047 Aug 31 09:42:11.254236 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 09:42:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:42:11.261062 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-a06cbf95-dd44-4b27-a858-0e3872ae2b96 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:11.275917 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-a06cbf95-dd44-4b27-a858-0e3872ae2b96 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018675 Aug 31 09:42:11.276611 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 09:42:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:42:11.286926 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:11.302126 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018714 Aug 31 09:42:11.302655 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Aug 31 09:42:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:42:11.312579 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-203a1636-bca7-4de6-b806-00a628b2b3ae admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:11.317868 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.wsgi [None req-203a1636-bca7-4de6-b806-00a628b2b3ae admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-203a1636-bca7-4de6-b806-00a628b2b3ae admin admin] Request method failure captured: Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Accept: application/json Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Accept-Encoding: gzip, deflate Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Connection: keep-alive Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Content-Length: 0 Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Host: 10.222.0.36 Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Openstack-Api-Version: compute 2.90 Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Openstack-System-Scope: None Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: User-Agent: python-novaclient Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Auth-Token: gAAAAABjDyzy-HjK2IYLVgGGJpUO4pOGKi1DSqZQQfKJpDJy-BHTODaVl9dLTs7ZqVqs5KltVyDep6WyB6NJNS6_utai2F-NreStMuCchVVhFEri6rEt4YgJu9vVn_uE4d6PnCjCOjC3rNQdrfXsQ8Ydxo3LU-WCCwOaNgzYegR_HVOmMVQMAO8 Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Domain-Id: None Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Domain-Name: None Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Identity-Status: Confirmed Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Is-Admin-Project: True Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Domain-Id: default Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Domain-Name: Default Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Project-Name: admin Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Role: reader,member,admin Aug 31 09:42:11.319402 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Roles: reader,member,admin Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d473eacf42fc47c2aa82e80873c7637e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Tenant: admin Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Tenant-Id: d473eacf42fc47c2aa82e80873c7637e Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-Tenant-Name: admin Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User: admin Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Domain-Id: default Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Domain-Name: Default Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Id: d7063e9478d747e983e7ced895545d44 Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: X-User-Name: admin Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: method: > Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: exception: Flavor 451 could not be found. Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: action_args: {'id': '451'} Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:42:11.320927 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:11.321973 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: ERROR nova.api.openstack.wsgi Aug 31 09:42:11.323281 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-203a1636-bca7-4de6-b806-00a628b2b3ae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117549) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:42:11.324473 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-203a1636-bca7-4de6-b806-00a628b2b3ae admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012400 Aug 31 09:42:11.324473 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 09:42:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 09:42:12.307054 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:12.308119 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 31 09:42:12.309154 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:12.837473 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-54074912-19ca-4623-bd20-d8ee5c77603d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:42:12.859011 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-54074912-19ca-4623-bd20-d8ee5c77603d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.411057 Aug 31 09:42:12.859609 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Aug 31 09:42:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:42:13.846578 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:13.847630 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 31 09:42:13.848029 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:42:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:14.388952 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-019a9740-42d3-48d2-89d7-e8b5ff29fcba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:42:14.407835 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-019a9740-42d3-48d2-89d7-e8b5ff29fcba admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.422110 Aug 31 09:42:14.408380 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Aug 31 09:42:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:42:15.426246 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:15.427477 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 31 09:42:15.427686 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:15.978748 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-c0f32f34-cfd7-4f4a-81e6-ee047fdbed86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:42:15.997946 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-c0f32f34-cfd7-4f4a-81e6-ee047fdbed86 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.422008 Aug 31 09:42:15.998399 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Aug 31 09:42:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:42:17.006717 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:17.008044 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 31 09:42:17.008435 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:42:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:17.553230 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-3975d5a7-4067-49f3-a9a6-40fbfdf93f2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:42:17.572362 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-3975d5a7-4067-49f3-a9a6-40fbfdf93f2c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.423136 Aug 31 09:42:17.572910 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Aug 31 09:42:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:42:18.568030 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:18.569074 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 31 09:42:18.569472 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:42:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:42:19.101814 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-5982066c-ce86-4052-9cdd-e3796ad04348 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:42:19.123335 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-5982066c-ce86-4052-9cdd-e3796ad04348 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.415394 Aug 31 09:42:19.123879 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Wed Aug 31 09:42:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:43:13.955765 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:43:13.956784 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-d17021f6-b5eb-4eca-9bfc-8768ce08fc53 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 31 09:43:13.957194 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 931 bytes} [Wed Aug 31 09:43:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:43:13.968052 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:43:14.364533 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-6a0db8a9-2163-4a8b-bede-1796742cd880 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:43:14.387147 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-6a0db8a9-2163-4a8b-bede-1796742cd880 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.423645 Aug 31 09:43:14.387708 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Aug 31 09:43:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:43:14.409831 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG dbcounter [-] [117548] Writing DB stats nova_api:SELECT=14 {{(pid=117548) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:43:14.413920 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-0c2c857c-c179-48df-b882-14eae6127e58 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:43:14.421976 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-0c2c857c-c179-48df-b882-14eae6127e58 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013583 Aug 31 09:43:14.422625 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1283 bytes} [Wed Aug 31 09:43:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:43:14.435312 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-a7a8e4f6-bbaf-4ebd-8830-ea0e0bb9e8ab admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:43:14.443046 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-a7a8e4f6-bbaf-4ebd-8830-ea0e0bb9e8ab admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011936 Aug 31 09:43:14.443631 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1286 bytes} [Wed Aug 31 09:43:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:43:14.456763 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:43:14.465236 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012017 Aug 31 09:43:14.465776 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1286 bytes} [Wed Aug 31 09:43:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:43:14.478050 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-b721d68d-0154-4faa-809e-2c8740ead5e1 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:43:14.486271 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-b721d68d-0154-4faa-809e-2c8740ead5e1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011806 Aug 31 09:43:14.486814 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1283 bytes} [Wed Aug 31 09:43:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:46:16.848990 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:16.850001 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 31 09:46:16.850399 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:46:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:46:16.995636 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_api:SELECT=6 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:17.157276 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-4cb4fb19-c52a-49fb-90b0-483528ea2267 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:17.160833 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-4cb4fb19-c52a-49fb-90b0-483528ea2267 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:17.161330 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-4cb4fb19-c52a-49fb-90b0-483528ea2267 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:17.161760 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-4cb4fb19-c52a-49fb-90b0-483528ea2267 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:17.162471 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-4cb4fb19-c52a-49fb-90b0-483528ea2267 admin admin] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:17.162915 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-4cb4fb19-c52a-49fb-90b0-483528ea2267 admin admin] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:17.163358 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-4cb4fb19-c52a-49fb-90b0-483528ea2267 admin admin] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:17.197847 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-4cb4fb19-c52a-49fb-90b0-483528ea2267 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204536 Aug 31 09:46:17.198409 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 09:46:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:46:18.052395 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:18.053402 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 31 09:46:18.053803 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:46:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:46:18.246924 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-8c7bdeb0-e43b-4a69-9899-f5dedc24d0ef admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:18.250389 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-8c7bdeb0-e43b-4a69-9899-f5dedc24d0ef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:18.250855 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-8c7bdeb0-e43b-4a69-9899-f5dedc24d0ef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:18.251314 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-8c7bdeb0-e43b-4a69-9899-f5dedc24d0ef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:18.252019 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-8c7bdeb0-e43b-4a69-9899-f5dedc24d0ef admin admin] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:18.252457 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-8c7bdeb0-e43b-4a69-9899-f5dedc24d0ef admin admin] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:18.252866 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-8c7bdeb0-e43b-4a69-9899-f5dedc24d0ef admin admin] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:18.272207 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-8c7bdeb0-e43b-4a69-9899-f5dedc24d0ef admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076471 Aug 31 09:46:18.273099 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 09:46:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:46:29.507084 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:29.508100 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 31 09:46:29.508491 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:46:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:46:29.654315 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_cell0:SELECT=4 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:29.655035 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_cell1:SELECT=4 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:29.655760 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG dbcounter [-] [117549] Writing DB stats nova_api:SELECT=8 {{(pid=117549) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:29.703977 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-12ac0009-75e4-49b5-9dfa-3e7db96fa83e admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:29.707343 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-12ac0009-75e4-49b5-9dfa-3e7db96fa83e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:29.707807 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-12ac0009-75e4-49b5-9dfa-3e7db96fa83e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:29.708230 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-12ac0009-75e4-49b5-9dfa-3e7db96fa83e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:29.708924 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-12ac0009-75e4-49b5-9dfa-3e7db96fa83e admin admin] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:29.709359 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-12ac0009-75e4-49b5-9dfa-3e7db96fa83e admin admin] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:29.709769 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-12ac0009-75e4-49b5-9dfa-3e7db96fa83e admin admin] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:29.734881 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-12ac0009-75e4-49b5-9dfa-3e7db96fa83e admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085575 Aug 31 09:46:29.735387 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 09:46:29 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:46:30.569544 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: DEBUG nova.api.openstack.wsgi [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] Calling method '>' {{(pid=117548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:30.570548 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: INFO nova.api.openstack.requestlog [None req-7eca4153-ac17-4710-9b8d-6fb23a9d5b88 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 31 09:46:30.570968 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: [pid: 117548|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Aug 31 09:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:46:30.764677 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG nova.api.openstack.wsgi [None req-b3cb551f-0af1-45ce-9ccd-1166ba1218b1 admin admin] Calling method '>' {{(pid=117549) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:46:30.768158 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-b3cb551f-0af1-45ce-9ccd-1166ba1218b1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:30.768635 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-b3cb551f-0af1-45ce-9ccd-1166ba1218b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:30.769066 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-b3cb551f-0af1-45ce-9ccd-1166ba1218b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:30.769783 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-b3cb551f-0af1-45ce-9ccd-1166ba1218b1 admin admin] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:46:30.770229 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-b3cb551f-0af1-45ce-9ccd-1166ba1218b1 admin admin] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:46:30.770650 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: DEBUG oslo_concurrency.lockutils [None req-b3cb551f-0af1-45ce-9ccd-1166ba1218b1 admin admin] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117549) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:46:30.793226 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: INFO nova.api.openstack.requestlog [None req-b3cb551f-0af1-45ce-9ccd-1166ba1218b1 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080220 Aug 31 09:46:30.793708 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: [pid: 117549|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Aug 31 09:46:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:47:29.667696 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: Wed Aug 31 09:47:29 2022 - graceful shutdown triggered... Aug 31 09:47:29.668227 dv-cinder-837543-8-iscsi devstack@n-api.service[117548]: Gracefully killing worker 1 (pid: 117548)... Aug 31 09:47:29.667816 dv-cinder-837543-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 09:47:29.670904 dv-cinder-837543-8-iscsi devstack@n-api.service[117549]: Gracefully killing worker 2 (pid: 117549)... Aug 31 09:47:30.668853 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: worker 1 buried after 1 seconds Aug 31 09:47:30.668853 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: worker 2 buried after 1 seconds Aug 31 09:47:30.669584 dv-cinder-837543-8-iscsi devstack@n-api.service[117547]: goodbye to uWSGI. Aug 31 09:47:30.670521 dv-cinder-837543-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 09:47:30.671102 dv-cinder-837543-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 09:47:30.673907 dv-cinder-837543-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 09:47:30.687803 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 09:47:30 2022] *** Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: nodename: dv-cinder-837543-8-iscsi Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: machine: x86_64 Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: clock source: unix Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: pcre jit disabled Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: detected number of CPU cores: 4 Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: current working directory: / Aug 31 09:47:30.690760 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: detected binary path: /usr/bin/uwsgi-core Aug 31 09:47:30.691973 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: your processes number limit is 47680 Aug 31 09:47:30.691973 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: your memory page size is 4096 bytes Aug 31 09:47:30.691973 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: detected max file descriptor number: 2048 Aug 31 09:47:30.691973 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: lock engine: pthread robust mutexes Aug 31 09:47:30.691973 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: thunder lock: enabled Aug 31 09:47:30.691973 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 09:47:30.691973 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 09:47:30.733600 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: Python main interpreter initialized at 0x556d448229c0 Aug 31 09:47:30.733600 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: python threads support enabled Aug 31 09:47:30.733600 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: your server socket listen backlog is limited to 100 connections Aug 31 09:47:30.733600 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: your mercy for graceful operations on workers is 90 seconds Aug 31 09:47:30.734055 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 09:47:30.734055 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: *** Operational MODE: preforking *** Aug 31 09:47:30.734362 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: *** uWSGI is running in multiple interpreter mode *** Aug 31 09:47:30.734362 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: spawned uWSGI master process (pid: 132548) Aug 31 09:47:30.734571 dv-cinder-837543-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 09:47:30.737518 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: spawned uWSGI worker 1 (pid: 132570, cores: 1) Aug 31 09:47:30.738100 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: spawned uWSGI worker 2 (pid: 132571, cores: 1) Aug 31 09:47:30.738404 dv-cinder-837543-8-iscsi devstack@n-api.service[132548]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 09:47:31.415850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:47:31.431362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 09:47:32.599146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:47:32.599146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: from cryptography.utils import int_from_bytes Aug 31 09:47:32.600632 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:47:32.600632 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: from cryptography.utils import int_from_bytes Aug 31 09:47:32.618323 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:47:32.618323 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: from cryptography.utils import int_from_bytes Aug 31 09:47:32.619063 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:47:32.619063 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: from cryptography.utils import int_from_bytes Aug 31 09:47:35.056711 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:47:35.057714 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:47:35.058492 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:47:35.059114 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:47:35.059613 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:47:35.060242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.060785 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.061328 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.061656 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.062168 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.062492 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.062829 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.063176 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.063519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.063785 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.064107 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.064499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-8-iscsi {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.064764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.065073 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.065387 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.065713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.066022 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.066348 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.066659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.067196 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.068692 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.068692 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.068692 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.068971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.069215 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.069508 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.069825 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.070185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.070513 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.070823 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.071263 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-8-iscsi {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.071585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.071886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.072206 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.072629 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.072947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.073273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.073589 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.073902 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.074220 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.074540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.074864 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.075220 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.075542 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.076027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.076485 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.076940 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.077398 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.077861 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.078310 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.078704 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.079216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.079716 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.080197 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.080685 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.081091 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.082085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.082229 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:47:35.082675 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:47:35.082987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:47:35.083405 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:47:35.083601 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.083723 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:47:35.084037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.084367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.084583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.084697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.084985 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.085284 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.085468 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.085659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.086057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.086200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.086395 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.086719 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.086859 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.087076 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.087367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.087462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.087707 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.087808 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.087969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.088142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.088445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.088553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.088772 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-8-iscsi {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.088897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.089183 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.089381 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.089511 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.089697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.090121 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.090452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.090560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.090646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.090719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.090789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.090941 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.091072 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.091353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.091559 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.091675 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.091980 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.092108 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.092377 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.092686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.092931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.093040 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.093260 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.093372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.093580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.093694 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.093898 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.094069 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.094216 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.094372 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.094519 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.094670 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.094834 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.095021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.095214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.095383 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.095542 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.095700 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-8-iscsi {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.095847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.096000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.096162 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.096308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.096515 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.096663 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.096819 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.096980 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.097139 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.097291 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.097439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.097583 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.097750 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.097981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.098130 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.098275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.098419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.098572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.098727 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.098952 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.099144 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.099310 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.099458 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.099458 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.101713 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.101713 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.102055 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.102228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.102408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.102578 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.102578 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.103018 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.103204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.103383 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.103543 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.103691 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.103847 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.104002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.104932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.105105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.105268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.105430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.105577 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.105730 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.105884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.106040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.106208 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.106367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.106525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.106682 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.106837 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.107000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.107256 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.107412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.107568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.107716 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.107876 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.108043 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.108189 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.108342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.108488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.108633 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.108790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.108998 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.109151 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.109297 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.109448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.109448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.109738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.112526 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.112718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.112874 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.113033 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.113195 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.113345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.113345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.113632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.113778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.113922 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.114083 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.114260 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.115296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.115456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.115635 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.115791 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.115949 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.116104 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.116259 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.116414 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.116618 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.116769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.117686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.117895 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.118082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.118241 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.118401 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.118562 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.118710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.118863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.119016 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.119312 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.119492 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.119656 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.119812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.119957 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.120113 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.120258 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.120258 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.120569 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.120724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.120878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.121023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.121176 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.121338 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.121501 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.121647 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.121800 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.121945 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.122089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.122243 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.122396 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.122692 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.122846 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.122993 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.123284 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.123486 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.123646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.123799 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.123945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.124090 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.124241 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.124401 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.125212 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.125501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.125655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.125803 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.125948 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.126107 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.126107 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.126392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.126546 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.126691 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.126691 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.126987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.127210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.127395 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.127553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.127697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.127856 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.128011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.128156 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.128300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.128300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.128592 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.128737 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.128881 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.129034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.129237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.129389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.129560 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.129985 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.130146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.130300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.130456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.130602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.130758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.130911 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.131058 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.131339 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.131500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.131646 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.131802 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.131960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.132114 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.132274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.132450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.132603 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.132903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.133058 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.133213 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.133374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.133521 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.133666 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.133810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.134046 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.134262 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.134422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.134585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.135486 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.135775 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.135928 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.135928 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.136222 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.136383 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.136539 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.136686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.136839 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.136996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.137183 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.137344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.137503 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.137656 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.137809 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.137962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.138108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.138275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.138423 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.138568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:47:35.138713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.138859 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.139026 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.139026 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.139452 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.139599 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.139751 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.139905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.140077 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.140234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.140388 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.140544 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.140690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.140690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.140990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.141154 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.141308 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.141456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.141601 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.141758 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.141905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.141905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.142186 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.142345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.142498 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.142663 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.142815 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.143136 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.143301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.143453 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.143616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.143783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.143936 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.144095 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.144254 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.144414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.144566 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.144731 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.145001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.145644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.145933 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.146109 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.146272 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.146437 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.146590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.146743 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.146901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.147064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.147298 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.147454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.147613 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.147773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.147932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.148654 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.148884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.149041 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.149194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.149391 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.149550 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.149698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.149854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.150000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.150153 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.150314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.150474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.150690 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.150844 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.150991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.151154 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.151307 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.151453 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.151611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.151766 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.151912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.152057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.152210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.152363 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.152518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.152682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.152682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.152975 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.152975 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.153427 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.153590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.153738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.153883 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.154042 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.154197 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.154353 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.154500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.154645 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.154809 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.154975 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.155748 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.155935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.156201 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.156355 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.156510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.156664 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.156818 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.156973 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.157121 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.157273 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.157422 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.157578 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.157802 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.157980 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.158131 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.158285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.158431 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.158577 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.158577 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.158876 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.159032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.159032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.159334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.159526 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.159705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.159854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.160060 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.160229 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.160385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.160554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.160718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.160871 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.161023 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.161181 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.161333 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.161493 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.161672 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.161832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.161986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.162145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.162307 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.162469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.162633 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.162794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.162948 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.163108 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.163287 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.163474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.163805 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.164489 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.164653 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.164805 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.164958 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.165129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.166064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.166255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.166255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.166687 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.166841 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.167077 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.167286 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.167450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.167623 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.167777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.167929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.168097 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.168250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.168403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.168554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.168719 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.168887 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.169040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.169191 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.169342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.170111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.170294 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.170459 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.170624 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.170778 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.170941 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.171101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.171294 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.171458 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.171627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.172360 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.172360 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.172690 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.172857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.173027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.173027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.173326 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.173479 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.173630 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.173810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.174095 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.174263 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.174424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.174424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.174731 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.174894 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.175067 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.175257 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.175429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.176235 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.176403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.176731 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.176900 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.177071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.177228 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.177389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.177543 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.177705 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.177868 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.178034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.178196 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.178349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.178516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.178679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.178679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.178986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.179196 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.179397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.179619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.179885 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.180116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.180279 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.180450 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.180610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.180778 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.180940 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.181092 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.181290 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.181455 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.181616 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.181778 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.181939 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.182092 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.182243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.182433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.182597 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.182760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.182913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.183073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.183928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.184301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.184468 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.184622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.184783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.184947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.185118 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.185295 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.185449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.185609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.186498 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.186771 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.187074 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.187260 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.187414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.187577 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.187747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.187900 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.188052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.188216 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.188385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.188537 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.188705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.188866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.189026 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.189178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.189338 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.189499 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.189499 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.189870 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.190025 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.190196 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.190362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.190519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.190684 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.190847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.191000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.191266 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.191427 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.191594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.191754 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.191917 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.192070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.192228 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.192380 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.192553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.192705 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.192866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.193029 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.193190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.193190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.193487 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.193639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.193790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.193943 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.194093 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.194093 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.194549 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.194719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.194909 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.195073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.195073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.195410 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.195571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.195734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.195913 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.195913 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.197313 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.197485 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.197641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.197792 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.197792 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.198107 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.198443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.198615 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.198770 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.198939 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.199053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.199217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.199321 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.199409 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.199501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.199594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.199694 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.199850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.199947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200042 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200569 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200773 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200773 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.200939 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201033 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201118 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201217 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201304 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201569 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201739 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.201926 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202113 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202365 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202459 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202716 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202803 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202895 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.202895 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203068 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203184 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203373 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203473 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203561 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203822 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.203909 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204003 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204089 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204181 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204360 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204446 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204645 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204739 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.204909 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205006 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205100 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205279 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205464 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205558 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205651 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205744 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205836 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.205922 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.206014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.206014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.206525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.206634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.206896 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207093 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207211 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.207868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208134 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208134 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208565 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208652 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208828 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.208915 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209008 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209108 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209194 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209375 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209459 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209459 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209716 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.209801 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.210026 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.210121 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.210217 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.210304 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.210389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.210477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.211219 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.211329 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.211428 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.211517 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.211602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.211695 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.211781 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.211866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.211960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212047 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212140 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.212931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213025 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213118 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213203 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213476 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213563 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213647 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213739 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213826 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.213924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214012 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214196 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214283 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214368 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214461 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214555 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214641 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214641 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214803 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.214889 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215025 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215302 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215483 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215676 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215763 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215848 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.215940 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.216038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.216125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.216217 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.216308 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.216402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.216477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.216839 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217181 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217279 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217366 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217817 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217902 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217902 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.217902 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218147 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218410 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218754 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218838 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.218922 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219015 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219110 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219306 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219495 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219748 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219839 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.219979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220189 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220283 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220384 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220472 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220564 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220815 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.220965 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221118 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221202 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221276 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221498 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221584 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221584 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221737 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.221953 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222115 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222189 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222338 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222408 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222486 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222801 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222873 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.222962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.223043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.223375 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.223465 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.223538 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.223609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.223767 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.223857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.223939 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224091 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224163 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224321 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224398 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224542 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224627 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224715 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.224938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225007 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225089 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225161 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225365 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225520 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225520 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.225694 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.226087 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.227243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.227345 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.227345 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.227649 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.227740 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.227970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.228054 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.228382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.228490 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.228677 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.228771 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.229005 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.229120 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.229351 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.229452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.229685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.229788 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.230036 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.230132 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.230340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.230433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.230648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.230740 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.230962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.231064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.231293 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.231392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.231603 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.231705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.231914 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.232013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.232226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.232320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.232541 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.232636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.232856 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.232959 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.233170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.233267 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.233492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.233626 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.233804 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.233921 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.234114 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.234307 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.234435 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.234625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.234775 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.234947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.235057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.235305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.235400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.235639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.235733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.235950 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.236051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.236263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.236365 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.236573 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.236677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.236890 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.237046 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.237448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.237550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.237729 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.237840 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.238048 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.238150 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.238363 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.238454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.238672 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.238777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.238988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.239090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.239363 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.239460 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.239681 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.239784 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.239996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.240088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.240307 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.240411 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.240726 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.240821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.241041 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.241142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.241356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.241459 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.241675 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.241813 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.242024 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.242132 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.242329 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.242623 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.242777 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.242954 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.243056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.243286 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.243397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.243600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.243723 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.243904 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.244007 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.244228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.244334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.244539 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.244642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.244852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.245011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.245171 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.245337 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.245484 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.245577 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.245796 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.245887 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.246134 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.246257 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.246450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.246551 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.246776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.246868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.247102 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.247307 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.247631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.247730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.247817 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.247910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.248070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.248165 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.248403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.248504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.248711 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.248812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.249018 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.249112 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.249327 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.249427 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.249637 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.249731 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.249947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.250042 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.250253 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.250355 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.250576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.250680 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.250900 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.250996 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.251239 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.251350 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.251567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.251669 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.251907 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.252002 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.252241 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.252343 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.252572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.252680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.252896 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.252997 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.253225 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.253335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.253534 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.253653 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.253924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.254016 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.254137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.254231 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.254443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.254538 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.255011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.255158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.255354 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.255448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.255657 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.255758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.255974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.256135 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.256286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.256452 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.256596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.256764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.256927 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.257071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.257240 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.257376 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.257703 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.257820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.258092 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.258359 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.258463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.258673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.258776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.258998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.259092 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.259345 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.259442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.259652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.259754 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.259975 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.260077 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.260285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.260380 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.260589 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.260684 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.260892 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.261000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.261195 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.261299 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.261538 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.261633 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.261849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.261942 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.262168 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.262272 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.262499 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.262600 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.262827 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.262921 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.263678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.263805 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.263917 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.264002 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.264075 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.264145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.264228 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.264328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.264423 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.264518 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.264938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.265040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.265270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.265364 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.265591 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.265693 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.265913 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.266013 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.266221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.266318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.266527 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.266627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.266843 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.266943 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.267184 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.267285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.267503 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.267614 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.267861 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.267951 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.268121 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.268217 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.268455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.268615 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.268783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.268892 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.269113 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.269208 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.269454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.269549 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.269756 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.269857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.270062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.270156 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.270368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.270462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.270689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.270796 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.271052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.271190 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.271434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.271537 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.271747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.271849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.272066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.272161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.272388 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.272481 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.272710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.272812 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.273547 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.273723 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.273931 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.274026 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.274250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.274523 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.274659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.274850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.274979 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.275204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.275304 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.275613 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.275708 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.275924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.276017 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.276242 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.276339 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.276580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.276803 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.276920 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.277138 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.277242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.277457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.277552 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.277784 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.277904 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.278088 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.278194 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.278403 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.278716 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.278857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.279026 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.279207 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.279351 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.279496 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.279659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.279802 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.279944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.280101 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.280267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.280412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.280590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.280732 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.281009 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.281159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.281350 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.281499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.281659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.281802 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.281960 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.282101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.282248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.282393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.282558 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.282704 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.282887 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.283037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.283268 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.283371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.283531 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.283647 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.283840 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.283934 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.284158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.284268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.284471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.284782 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.284886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.285093 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.285188 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.285407 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.285509 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.285720 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.285815 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.286035 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.286138 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.286345 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.286449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.286659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.286779 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.286973 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.287081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.287331 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.287441 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.287660 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.287759 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.287987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.288136 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.288303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.288452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.288612 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.288810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.289515 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.289695 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.290070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.290401 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.290610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.290887 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.290982 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.291260 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.291386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.291576 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.291682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.291909 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.292003 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.292222 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.292337 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.292540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.292641 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.292855 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.292950 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.293170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.293277 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.293482 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.293583 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.293793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.293893 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.294104 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.294210 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.294409 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.294498 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.294732 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.294839 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.295040 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.295143 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.295377 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.295461 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.295695 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.295810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.296001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.296096 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.296324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.296644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.296736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.297019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.297135 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.297336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.297429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.297657 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.297760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.297974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.298104 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.298291 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.298433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.298602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.298776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.298928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.299067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.299249 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.299344 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.299557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.299640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.299875 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.299978 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.300187 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.300283 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.300493 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.300798 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.300902 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.301109 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.301211 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.301421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.301518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.301727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.301836 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.302037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.302132 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.302348 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.302452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.302674 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.302770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.302981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.303075 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.303312 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.303409 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.303620 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.303715 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.303931 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.304036 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.304236 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.304369 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.304630 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.305026 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.305209 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.305340 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.305645 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.305755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.305963 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.306057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.306272 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.306376 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.306585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.306694 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.306894 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.306997 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.307234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.307347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.307544 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.307735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.307857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.307956 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.308271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.308390 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.308507 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.308611 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.308836 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.308942 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.309143 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.309272 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.309468 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.309594 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.309780 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.309918 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.310099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.310191 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.310411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.310506 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.310725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.310834 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.311041 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.311161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.311391 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.311488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.311716 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.311995 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.312098 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.312332 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.312428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.312653 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.312748 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.313004 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.313099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.313338 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.313434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.313648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.313800 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.313976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.314118 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.314268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.314412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.314604 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.314765 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.314861 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.315028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.315178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.315382 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.315485 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.315709 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.315817 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.316027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.316125 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.316359 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.316452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.316668 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.316768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.316978 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.317072 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.317287 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.317379 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.317597 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.317698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.317904 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.318019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.318331 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.318477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.318582 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.318689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.318813 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.318931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.319169 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.319287 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.319511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.319635 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.319840 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.320043 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.320199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.320470 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.320569 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.320815 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.321014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.321119 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.321525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.321619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.321850 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.321963 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.322164 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.322256 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.322477 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.322579 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.322787 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.322889 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.323102 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.323234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.323442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.323537 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.323756 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.323859 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.324070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.324172 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.324383 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.324487 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.324699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.324802 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.325011 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.325100 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.325324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.325439 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.325634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.325730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.325947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.326041 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.326265 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.326375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.326590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.326685 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.326926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.327030 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.327270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.327383 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.327601 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.327697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.327922 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.328026 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.328228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.328346 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.328537 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.328684 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.328840 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.328924 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.329218 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.329335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.329463 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.329559 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.329773 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.329868 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.330078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.330191 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.330381 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.330492 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.330691 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.330794 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.330998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.331101 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.331326 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.331440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.331628 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.331736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.331937 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.332078 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.332240 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.332342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.332541 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.332649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.332855 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.332948 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.333159 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.333253 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.333463 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.333566 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.333766 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.333867 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.334072 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.334176 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.334379 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.334488 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.334682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.334783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.334987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.335081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.335320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.335498 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.336333 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.336462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.336571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.336807 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.336918 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.337134 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.337244 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.337448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.337542 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.337772 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.337963 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.338086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.338189 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.338413 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.338537 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.338725 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.338868 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.339045 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.339177 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.339399 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.339512 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.339725 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.339883 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.340034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.340171 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.340370 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.340466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.340683 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.340786 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.340993 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.341088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.341304 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.341413 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.341610 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.341713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.341919 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.342013 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.342227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.342329 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.342560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.342654 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.342830 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:47:35.342929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.343225 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.343555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.343874 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.344199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.344516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.344826 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.345156 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.345620 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.345769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.346074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.346382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.346689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.347001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.347332 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.347643 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.347962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.348394 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.348732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.349059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.349369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.349695 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.350059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.350489 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.350966 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.351240 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.352555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.352555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.352969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.352969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:47:35.353264 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132570) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:47:35.407944 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO dbcounter [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Registered counter for database nova_api Aug 31 09:47:35.416351 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO dbcounter [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Registered counter for database nova_api Aug 31 09:47:35.430386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:35.437484 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writer thread running {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:35.438118 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:35.445384 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writer thread running {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:35.496194 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.context [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2892fd19-82dd-46bd-9aca-c75fabb94ea6(cell1) {{(pid=132571) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:47:35.500326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:35.500808 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:35.501590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.context [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2892fd19-82dd-46bd-9aca-c75fabb94ea6(cell1) {{(pid=132570) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 09:47:35.502434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.503226 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:35.503682 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:35.505992 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:35.506120 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.506446 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:35.508898 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.509036 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO dbcounter [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Registered counter for database nova_cell0 Aug 31 09:47:35.509625 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:47:35.510067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:47:35.512208 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:47:35.513230 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO dbcounter [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Registered counter for database nova_cell1 Aug 31 09:47:35.514249 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO dbcounter [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Registered counter for database nova_cell0 Aug 31 09:47:35.518422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO dbcounter [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Registered counter for database nova_cell1 Aug 31 09:47:35.520758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:35.522333 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:35.527507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:35.529343 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:35.530325 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writer thread running {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:35.531640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writer thread running {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:35.535294 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writer thread running {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:35.537323 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writer thread running {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:35.682434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO dbcounter [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Registered counter for database nova_cell0 Aug 31 09:47:35.687899 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO dbcounter [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Registered counter for database nova_cell0 Aug 31 09:47:35.689408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:35.694339 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writer thread running {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:35.695587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_db.sqlalchemy.engines [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132570) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:47:35.700190 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writer thread running {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:47:36.030407 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: WARNING keystonemiddleware.auth_token [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:47:36.037832 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: WARNING keystonemiddleware.auth_token [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:47:36.038497 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: WARNING keystonemiddleware.auth_token [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:47:36.047646 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: WARNING keystonemiddleware.auth_token [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:47:36.422695 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: WARNING keystonemiddleware.auth_token [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:47:36.425501 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: WARNING keystonemiddleware.auth_token [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 09:47:36.428891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: WARNING keystonemiddleware.auth_token [None req-3c9f9405-c7a1-422b-b716-250c3b335d81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:47:36.432883 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: WARNING keystonemiddleware.auth_token [None req-6fd3bddb-53d7-4b16-9d6d-15c90f8694b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 09:47:36.435479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d448229c0 pid: 132570 (default app) Aug 31 09:47:36.438218 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d448229c0 pid: 132571 (default app) Aug 31 09:48:17.723104 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:17.724443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:17.725238 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:17.725409 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:17.725572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:17.726628 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:17.726813 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:17.727097 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:19.362394 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-660837ac-912f-4ccd-a7a5-9a8424df562f tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Action: 'create', calling method: .version_select at 0x7f9463a8de50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1722368691", "metadata": {"Type": "work"}}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-660837ac-912f-4ccd-a7a5-9a8424df562f tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Request method failure captured: Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 122 Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy5hrfabSLYeYN_kuYigKuWSlRzrwQh3C2ypx-OLp64S5QYXVsg6Kt6D473f-j3FxeECyxRM-vAFHG7SXFFSres63116FOxf9wMpTAYrkTV9vtY0Y8Uqzy7eFjoskS_RkDYGhGVNsNiT4dgq7hTywr6rBcIeXLJAkxXGDmmkfKT46z0 Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:48:19.371190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 43aa3506f7f64ea7a6d57f0087092334 Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1722368691", "metadata": {"Type": "work"}}} Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: Aug 31 09:48:19.372860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1722368691', 'metadata': {'Type': 'work'}}}} Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise error Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:19.373772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 09:48:19.375363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 09:48:19.376724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 09:48:19.376724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:19.379668 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-660837ac-912f-4ccd-a7a5-9a8424df562f tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:19.382822 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-660837ac-912f-4ccd-a7a5-9a8424df562f tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.664818 Aug 31 09:48:19.384709 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Aug 31 09:48:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1668 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 09:48:19.682883 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-078250fe-e32b-4609-8c65-a0c135931c1e tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] Action: 'create', calling method: .version_select at 0x7f94639d7940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-29194126", "metadata": {"Type": "work"}}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:19.896709 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2a0d23cf-f263-42f9-b9a5-99d3d11dc0f4 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Action: 'create', calling method: .version_select at 0x7f9463a90e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1305079908"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:21.563343 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-078250fe-e32b-4609-8c65-a0c135931c1e tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.174162 Aug 31 09:48:21.564593 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 2/2] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Aug 31 09:48:19 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2179 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 09:48:21.591865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1cac0166-21b7-4f87-95f8-b720b4832946 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Action: 'create', calling method: .version_select at 0x7f94638e31f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1344486075", "metadata": {"Type": "work"}}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1cac0166-21b7-4f87-95f8-b720b4832946 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Request method failure captured: Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 120 Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy5hrfabSLYeYN_kuYigKuWSlRzrwQh3C2ypx-OLp64S5QYXVsg6Kt6D473f-j3FxeECyxRM-vAFHG7SXFFSres63116FOxf9wMpTAYrkTV9vtY0Y8Uqzy7eFjoskS_RkDYGhGVNsNiT4dgq7hTywr6rBcIeXLJAkxXGDmmkfKT46z0 Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:48:21.602081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 43aa3506f7f64ea7a6d57f0087092334 Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1344486075", "metadata": {"Type": "work"}}} Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: Aug 31 09:48:21.604874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1344486075', 'metadata': {'Type': 'work'}}}} Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise error Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi '0' Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:21.606649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 09:48:21.612001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 09:48:21.619550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 09:48:21.619550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:21.619550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1cac0166-21b7-4f87-95f8-b720b4832946 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:21.622461 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1cac0166-21b7-4f87-95f8-b720b4832946 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.038374 Aug 31 09:48:21.635988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 3/3] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Aug 31 09:48:21 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:48:21.647765 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7ef6df8f-23f3-40fd-95aa-e356061ebffc tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] Calling method '.version_select at 0x7f946393a1f0>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:22.512631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7ef6df8f-23f3-40fd-95aa-e356061ebffc tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25" status: 200 len: 352 microversion: 2.1 time: 0.874371 Aug 31 09:48:22.513319 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 4/4] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:21 2022] GET /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25 => generated 352 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:22.519348 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b85e5c3c-901d-4329-9f2f-d30190a5a826 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Action: 'create', calling method: .version_select at 0x7f94638e3670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-596016215", "metadata": {"Type": "work"}}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b85e5c3c-901d-4329-9f2f-d30190a5a826 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Request method failure captured: Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 118 Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy5hrfabSLYeYN_kuYigKuWSlRzrwQh3C2ypx-OLp64S5QYXVsg6Kt6D473f-j3FxeECyxRM-vAFHG7SXFFSres63116FOxf9wMpTAYrkTV9vtY0Y8Uqzy7eFjoskS_RkDYGhGVNsNiT4dgq7hTywr6rBcIeXLJAkxXGDmmkfKT46z0 Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:48:22.535424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 43aa3506f7f64ea7a6d57f0087092334 Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-596016215", "metadata": {"Type": "work"}}} Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: Aug 31 09:48:22.537069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-596016215', 'metadata': {'Type': 'work'}}}} Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise error Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi '' Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:22.538590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 09:48:22.540125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 09:48:22.542852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 09:48:22.542852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.550752 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b85e5c3c-901d-4329-9f2f-d30190a5a826 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:22.557099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b85e5c3c-901d-4329-9f2f-d30190a5a826 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.041201 Aug 31 09:48:22.558580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 5/5] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Aug 31 09:48:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:48:22.583572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c208efb1-97ad-47dc-9abe-916863e00312 tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] Calling method '.version_select at 0x7f94638e4c10>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:22.690620 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2a0d23cf-f263-42f9-b9a5-99d3d11dc0f4 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.982972 Aug 31 09:48:22.692067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 1/6] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Aug 31 09:48:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4988 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 09:48:22.699520 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7275c30a-9907-42ba-8e01-26283a7bba00 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Calling method '.version_select at 0x7f9463915ca0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:22.775193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-7275c30a-9907-42ba-8e01-26283a7bba00 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] HTTP exception thrown: Volume tempest-invalid-1203844026 could not be found. Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7275c30a-9907-42ba-8e01-26283a7bba00 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Request method failure captured: Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1203844026 HTTP/1.1 Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy5hrfabSLYeYN_kuYigKuWSlRzrwQh3C2ypx-OLp64S5QYXVsg6Kt6D473f-j3FxeECyxRM-vAFHG7SXFFSres63116FOxf9wMpTAYrkTV9vtY0Y8Uqzy7eFjoskS_RkDYGhGVNsNiT4dgq7hTywr6rBcIeXLJAkxXGDmmkfKT46z0 Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:48:22.780789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 43aa3506f7f64ea7a6d57f0087092334 Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Volume tempest-invalid-1203844026 could not be found. Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'tempest-invalid-1203844026'} Aug 31 09:48:22.782275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1203844026 could not be found. (HTTP 404) (Request-ID: req-8ce8dcde-98b1-483e-9af0-f0960812c6e0) Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:22.783043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:48:22.784516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1203844026 could not be found. Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:22.785983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1203844026 could not be found. Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1203844026 could not be found. Aug 31 09:48:22.787512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:22.832101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7275c30a-9907-42ba-8e01-26283a7bba00 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Returning 404 to user: Volume tempest-invalid-1203844026 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:22.832101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7275c30a-9907-42ba-8e01-26283a7bba00 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1203844026" status: 404 len: 99 microversion: 2.1 time: 0.098237 Aug 31 09:48:22.832101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 2/7] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Aug 31 09:48:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1203844026 => generated 99 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 09:48:22.832101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-caf3a0f6-2821-4f84-a55c-b10958b6e77c tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f946429d3a0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:22.882941 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c208efb1-97ad-47dc-9abe-916863e00312 tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25" status: 200 len: 352 microversion: 2.1 time: 0.320949 Aug 31 09:48:22.883911 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 6/8] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:22 2022] GET /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25 => generated 352 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:22.889237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-69dd21ed-31c9-4c68-8c36-f682e9c6d820 tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004254 Aug 31 09:48:22.896625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 7/9] 10.222.0.36 () {58 vars in 1140 bytes} [Wed Aug 31 09:48:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 09:48:22.909455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-578b2017-650e-43f9-95c9-d00f5ccdd1cc tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012244 Aug 31 09:48:22.917328 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 8/10] 10.222.0.36 () {58 vars in 1137 bytes} [Wed Aug 31 09:48:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 09:48:22.931714 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9709e3e6-69dc-41a2-99bc-9def3f09c93e tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] Calling method '.version_select at 0x7f94638e4310>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:23.015687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-caf3a0f6-2821-4f84-a55c-b10958b6e77c tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3" status: 200 len: 345 microversion: 2.1 time: 0.217947 Aug 31 09:48:23.022631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 3/11] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:22 2022] GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 => generated 345 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:23.022631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d4674615-6aaf-4c15-b91d-d6af49d59f8e tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Calling method '.version_select at 0x7f946387b3a0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:23.076206 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9709e3e6-69dc-41a2-99bc-9def3f09c93e tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25" status: 202 len: 0 microversion: 2.1 time: 0.156029 Aug 31 09:48:23.076907 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 9/12] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:48:22 2022] DELETE /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:48:23.086214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f550133c-2f59-457b-8088-95141ab9eb1d tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] Calling method '.version_select at 0x7f94638e3a60>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:23.097706 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-d4674615-6aaf-4c15-b91d-d6af49d59f8e tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] HTTP exception thrown: Volume d981aa93-68f7-4045-98bc-f72e522abae0 could not be found. Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d4674615-6aaf-4c15-b91d-d6af49d59f8e tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Request method failure captured: Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: DELETE /compute/v2.1/os-volumes/d981aa93-68f7-4045-98bc-f72e522abae0 HTTP/1.1 Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy5hrfabSLYeYN_kuYigKuWSlRzrwQh3C2ypx-OLp64S5QYXVsg6Kt6D473f-j3FxeECyxRM-vAFHG7SXFFSres63116FOxf9wMpTAYrkTV9vtY0Y8Uqzy7eFjoskS_RkDYGhGVNsNiT4dgq7hTywr6rBcIeXLJAkxXGDmmkfKT46z0 Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:48:23.100382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 43aa3506f7f64ea7a6d57f0087092334 Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Volume d981aa93-68f7-4045-98bc-f72e522abae0 could not be found. Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'd981aa93-68f7-4045-98bc-f72e522abae0'} Aug 31 09:48:23.101400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d981aa93-68f7-4045-98bc-f72e522abae0 could not be found. (HTTP 404) (Request-ID: req-0bafa2cd-40a7-48c2-9cc6-fb7ec61d0b31) Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:23.102013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:48:23.102833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d981aa93-68f7-4045-98bc-f72e522abae0 could not be found. Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 09:48:23.103835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d981aa93-68f7-4045-98bc-f72e522abae0 could not be found. Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d981aa93-68f7-4045-98bc-f72e522abae0 could not be found. Aug 31 09:48:23.104632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.106271 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d4674615-6aaf-4c15-b91d-d6af49d59f8e tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Returning 404 to user: Volume d981aa93-68f7-4045-98bc-f72e522abae0 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:23.108317 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d4674615-6aaf-4c15-b91d-d6af49d59f8e tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/d981aa93-68f7-4045-98bc-f72e522abae0" status: 404 len: 109 microversion: 2.1 time: 0.089909 Aug 31 09:48:23.109233 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 4/13] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:48:23 2022] DELETE /compute/v2.1/os-volumes/d981aa93-68f7-4045-98bc-f72e522abae0 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:23.132527 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-db662212-53c5-43bb-a831-34dc05e83c0a tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Calling method '.version_select at 0x7f9463897160>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:23.191057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f550133c-2f59-457b-8088-95141ab9eb1d tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25" status: 200 len: 351 microversion: 2.1 time: 0.109491 Aug 31 09:48:23.191672 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 10/14] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:23 2022] GET /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:23.215454 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-db662212-53c5-43bb-a831-34dc05e83c0a tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] HTTP exception thrown: Volume cd58fe23-4bc4-4136-b66a-02c902a21372 could not be found. Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-db662212-53c5-43bb-a831-34dc05e83c0a tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Request method failure captured: Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/os-volumes/cd58fe23-4bc4-4136-b66a-02c902a21372 HTTP/1.1 Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy5hrfabSLYeYN_kuYigKuWSlRzrwQh3C2ypx-OLp64S5QYXVsg6Kt6D473f-j3FxeECyxRM-vAFHG7SXFFSres63116FOxf9wMpTAYrkTV9vtY0Y8Uqzy7eFjoskS_RkDYGhGVNsNiT4dgq7hTywr6rBcIeXLJAkxXGDmmkfKT46z0 Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:48:23.217433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e45b8d5877454f1fadf465070b4a1694"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: e45b8d5877454f1fadf465070b4a1694 Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-VolumesNegativeTest-1524308920 Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 43aa3506f7f64ea7a6d57f0087092334 Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-VolumesNegativeTest-1524308920-project Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Volume cd58fe23-4bc4-4136-b66a-02c902a21372 could not be found. Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'cd58fe23-4bc4-4136-b66a-02c902a21372'} Aug 31 09:48:23.219356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd58fe23-4bc4-4136-b66a-02c902a21372 could not be found. (HTTP 404) (Request-ID: req-3f7ccb58-db3d-4e8b-98d4-7120c1333735) Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:23.220502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:23.222081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd58fe23-4bc4-4136-b66a-02c902a21372 could not be found. Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:48:23.223862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd58fe23-4bc4-4136-b66a-02c902a21372 could not be found. Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd58fe23-4bc4-4136-b66a-02c902a21372 could not be found. Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-db662212-53c5-43bb-a831-34dc05e83c0a tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] Returning 404 to user: Volume cd58fe23-4bc4-4136-b66a-02c902a21372 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-db662212-53c5-43bb-a831-34dc05e83c0a tempest-VolumesNegativeTest-1524308920 tempest-VolumesNegativeTest-1524308920-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/cd58fe23-4bc4-4136-b66a-02c902a21372" status: 404 len: 109 microversion: 2.1 time: 0.102144 Aug 31 09:48:23.225535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 5/15] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:23 2022] GET /compute/v2.1/os-volumes/cd58fe23-4bc4-4136-b66a-02c902a21372 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:24.036451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0c4997fc-eb96-40f4-97be-912fdf651c49 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f94638e3310>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:24.225367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-13fc76a7-e3fc-44ca-8072-7d5cf48ba1b0 tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] Calling method '.version_select at 0x7f9463915ee0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:24.281755 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0c4997fc-eb96-40f4-97be-912fdf651c49 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3" status: 200 len: 346 microversion: 2.1 time: 0.254044 Aug 31 09:48:24.283173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 11/16] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:24 2022] GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 => generated 346 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:24.310668 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e5427024-4d78-4de8-bda3-7e059811f8b8 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Action: 'create', calling method: .version_select at 0x7f94638e4160>, body: {"snapshot": {"volume_id": "d0ab717f-2a80-4f15-99a9-157a3d9dcda3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-137284197"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:24.332897 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-13fc76a7-e3fc-44ca-8072-7d5cf48ba1b0 tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] HTTP exception thrown: Volume c9526e92-1d84-48f3-9471-a76a9f663e25 could not be found. Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-13fc76a7-e3fc-44ca-8072-7d5cf48ba1b0 tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] Request method failure captured: Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25 HTTP/1.1 Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy5hdY82mbvQCiR-eFAgBsrpLISR3EiOhMTuU0z3hVsWkyAefFe-88dZi9-BA8o0QB2YnDH-cgrKGTQlPSrl18_u07ot6XZL1Jleya-i6Z_MpuPpoZPoz_baYWKJig-SQgzJxKRhdJE6rI4p-sZ-7WZcrryV_g4Mi1pWzxPd2DH5KTM Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 3ef3ed4828bc4d04bf1896d4b627dad5 Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-VolumesGetTestJSON-345645077 Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:48:24.336967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3ef3ed4828bc4d04bf1896d4b627dad5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3ef3ed4828bc4d04bf1896d4b627dad5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3ef3ed4828bc4d04bf1896d4b627dad5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3ef3ed4828bc4d04bf1896d4b627dad5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-VolumesGetTestJSON-345645077 Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 3ef3ed4828bc4d04bf1896d4b627dad5 Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-VolumesGetTestJSON-345645077 Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-VolumesGetTestJSON-345645077-project Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 39de236db3f84712a7982697d7ac2ad1 Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-VolumesGetTestJSON-345645077-project Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Volume c9526e92-1d84-48f3-9471-a76a9f663e25 could not be found. Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'c9526e92-1d84-48f3-9471-a76a9f663e25'} Aug 31 09:48:24.338053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9526e92-1d84-48f3-9471-a76a9f663e25 could not be found. (HTTP 404) (Request-ID: req-5beef889-ac52-4754-b7de-84d113900d81) Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:24.338655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:24.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9526e92-1d84-48f3-9471-a76a9f663e25 could not be found. Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:48:24.340437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9526e92-1d84-48f3-9471-a76a9f663e25 could not be found. Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9526e92-1d84-48f3-9471-a76a9f663e25 could not be found. Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:24.342020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-13fc76a7-e3fc-44ca-8072-7d5cf48ba1b0 tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] Returning 404 to user: Volume c9526e92-1d84-48f3-9471-a76a9f663e25 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:24.344599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-13fc76a7-e3fc-44ca-8072-7d5cf48ba1b0 tempest-VolumesGetTestJSON-345645077 tempest-VolumesGetTestJSON-345645077-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25" status: 404 len: 109 microversion: 2.1 time: 0.123974 Aug 31 09:48:24.345684 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 6/17] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:24 2022] GET /compute/v2.1/os-volumes/c9526e92-1d84-48f3-9471-a76a9f663e25 => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:25.241331 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e5427024-4d78-4de8-bda3-7e059811f8b8 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.937035 Aug 31 09:48:25.242819 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 12/18] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Aug 31 09:48:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:48:25.269743 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0acfb7f4-ce3c-418b-b453-479bed66bea0 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f9463915b80>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:25.354426 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0acfb7f4-ce3c-418b-b453-479bed66bea0 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 200 len: 286 microversion: 2.1 time: 0.098742 Aug 31 09:48:25.355860 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 7/19] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:25 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:25.398150 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2bae853c-b75b-466b-8ab0-b1d527127912 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f94638e33a0>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:25.546817 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2bae853c-b75b-466b-8ab0-b1d527127912 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.175902 Aug 31 09:48:25.560925 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 13/20] 10.222.0.36 () {58 vars in 1140 bytes} [Wed Aug 31 09:48:25 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:25.573512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c46e6403-2e57-473a-a8da-a504911f6ec8 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f946387b790>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:25.693504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c46e6403-2e57-473a-a8da-a504911f6ec8 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 200 len: 286 microversion: 2.1 time: 0.129642 Aug 31 09:48:25.703836 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 8/21] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:25 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:26.711542 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6ec4d5ea-f8f1-45c7-b202-169fbced2877 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f9463875670>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:26.820666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6ec4d5ea-f8f1-45c7-b202-169fbced2877 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 200 len: 286 microversion: 2.1 time: 0.113438 Aug 31 09:48:26.821668 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 14/22] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:26 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:27.841303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4e66b16b-bba7-432e-b3bb-4bf3689ec379 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f946387bca0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:27.945488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4e66b16b-bba7-432e-b3bb-4bf3689ec379 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 200 len: 286 microversion: 2.1 time: 0.113709 Aug 31 09:48:27.946470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 9/23] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:27 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:28.972347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-deb78822-2f04-40ab-9a46-71d8470c03cd tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f94638e3f70>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:29.066550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-deb78822-2f04-40ab-9a46-71d8470c03cd tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 200 len: 286 microversion: 2.1 time: 0.110893 Aug 31 09:48:29.067159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 15/24] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:28 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:48:30.080851 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b513c948-cf78-4443-896e-18d79b69bb3f tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f94638973a0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:30.156149 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b513c948-cf78-4443-896e-18d79b69bb3f tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 200 len: 286 microversion: 2.1 time: 0.079019 Aug 31 09:48:30.156719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 10/25] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:30 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:48:31.175967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c6d9af95-0192-4bc9-ad0d-7025e23c8062 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f94638e3d30>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:31.534384 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c6d9af95-0192-4bc9-ad0d-7025e23c8062 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 200 len: 286 microversion: 2.1 time: 0.365395 Aug 31 09:48:31.539137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 16/26] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:31 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 286 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:32.551281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1cbf8e4e-1ca3-42de-b5dd-8e578f2fef39 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f946387ba60>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:32.616046 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1cbf8e4e-1ca3-42de-b5dd-8e578f2fef39 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 200 len: 287 microversion: 2.1 time: 0.068736 Aug 31 09:48:32.617592 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 11/27] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:32 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:32.631785 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b9dcedc8-8903-4a49-9d9e-1736f4aff563 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f94638e45e0>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:32.813765 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b9dcedc8-8903-4a49-9d9e-1736f4aff563 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 202 len: 0 microversion: 2.1 time: 0.188537 Aug 31 09:48:32.814343 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 17/28] 10.222.0.36 () {58 vars in 1254 bytes} [Wed Aug 31 09:48:32 2022] DELETE /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:48:32.823623 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9334dc96-7f50-4c2c-bdc7-0a4bcb788e3e tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f946387b3a0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:32.870467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9334dc96-7f50-4c2c-bdc7-0a4bcb788e3e tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 200 len: 286 microversion: 2.1 time: 0.051046 Aug 31 09:48:32.871687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 12/29] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:32 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:33.887467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-84d7c8b3-0928-4637-9d4b-d84f6864c345 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f9463915dc0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:33.984689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-84d7c8b3-0928-4637-9d4b-d84f6864c345 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] HTTP exception thrown: Snapshot 57a4b9d3-820c-4e39-8084-23fbfa91d6ed could not be found. Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-84d7c8b3-0928-4637-9d4b-d84f6864c345 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Request method failure captured: Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed HTTP/1.1 Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy5hsGlYlY7ln9Iwr_YI_JNR9wS0sOlmo0IVTQYHiFQt2cFHwoQ4bnxpEd79wINl0dEFdTm-7IhAg7SseMvP4cEGVGazP6QpOJEFva9_jQAoQ0lChl1TVCJcOWVgkY6rGAsgwbALOsZpsvOUbtree820qKlr_fbwZh8koIYaKgowIlE Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: e5b56cc9afe641ae8f21b59f77301f1e Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:48:33.988557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: e5b56cc9afe641ae8f21b59f77301f1e Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-VolumesSnapshotsTestJSON-915840289-project Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 9ba257f98cb64603a82b1c702659bbcd Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-VolumesSnapshotsTestJSON-915840289-project Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Snapshot 57a4b9d3-820c-4e39-8084-23fbfa91d6ed could not be found. Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': '57a4b9d3-820c-4e39-8084-23fbfa91d6ed'} Aug 31 09:48:33.991067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 57a4b9d3-820c-4e39-8084-23fbfa91d6ed could not be found. (HTTP 404) (Request-ID: req-df76f0e1-4c6c-46d9-9ace-e7438e4b3fb9) Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:33.992144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:33.993086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 57a4b9d3-820c-4e39-8084-23fbfa91d6ed could not be found. Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 09:48:33.993981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 57a4b9d3-820c-4e39-8084-23fbfa91d6ed could not be found. Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 57a4b9d3-820c-4e39-8084-23fbfa91d6ed could not be found. Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-84d7c8b3-0928-4637-9d4b-d84f6864c345 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Returning 404 to user: Snapshot 57a4b9d3-820c-4e39-8084-23fbfa91d6ed could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-84d7c8b3-0928-4637-9d4b-d84f6864c345 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed" status: 404 len: 111 microversion: 2.1 time: 0.107669 Aug 31 09:48:33.995012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 13/30] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Aug 31 09:48:33 2022] GET /compute/v2.1/os-snapshots/57a4b9d3-820c-4e39-8084-23fbfa91d6ed => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:34.006417 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f0de9bc1-ac4a-4c51-84d5-cc1d46e9333b tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f946387b670>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:34.020332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1249310463", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:34.223486 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f0de9bc1-ac4a-4c51-84d5-cc1d46e9333b tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3" status: 202 len: 0 microversion: 2.1 time: 0.223507 Aug 31 09:48:34.225191 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 14/31] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:48:33 2022] DELETE /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:48:34.237834 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3fdbe0ee-7859-4467-9c71-ba36b38bb574 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f946387ba60>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:34.346435 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] validate_networks() for [('d29a8f85-a955-420e-adfc-3d7c1f060852', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:48:34.363191 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3fdbe0ee-7859-4467-9c71-ba36b38bb574 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3" status: 200 len: 345 microversion: 2.1 time: 0.131060 Aug 31 09:48:34.364821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 15/32] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:34 2022] GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 => generated 345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:48:35.379776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ccf8befd-a73c-4b6c-b781-1de1d89fa0b7 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f94638971f0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:35.605717 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-ccf8befd-a73c-4b6c-b781-1de1d89fa0b7 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] HTTP exception thrown: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ccf8befd-a73c-4b6c-b781-1de1d89fa0b7 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Request method failure captured: Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 HTTP/1.1 Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy5hsGlYlY7ln9Iwr_YI_JNR9wS0sOlmo0IVTQYHiFQt2cFHwoQ4bnxpEd79wINl0dEFdTm-7IhAg7SseMvP4cEGVGazP6QpOJEFva9_jQAoQ0lChl1TVCJcOWVgkY6rGAsgwbALOsZpsvOUbtree820qKlr_fbwZh8koIYaKgowIlE Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: e5b56cc9afe641ae8f21b59f77301f1e Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:48:35.612062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: e5b56cc9afe641ae8f21b59f77301f1e Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-VolumesSnapshotsTestJSON-915840289-project Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 9ba257f98cb64603a82b1c702659bbcd Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-VolumesSnapshotsTestJSON-915840289-project Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'd0ab717f-2a80-4f15-99a9-157a3d9dcda3'} Aug 31 09:48:35.614124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. (HTTP 404) (Request-ID: req-4b0c259b-3d0a-40a5-aa02-2af24622a2eb) Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:35.615924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:35.617920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:48:35.619755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.621471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.625525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ccf8befd-a73c-4b6c-b781-1de1d89fa0b7 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Returning 404 to user: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:35.633722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ccf8befd-a73c-4b6c-b781-1de1d89fa0b7 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3" status: 404 len: 109 microversion: 2.1 time: 0.259085 Aug 31 09:48:35.639332 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 16/33] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:35 2022] GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 => generated 109 bytes in 263 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:48:35.659846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7c83ed16-1900-4afe-9c4b-0470f2caf662 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f946387b4c0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:35.814006 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-7c83ed16-1900-4afe-9c4b-0470f2caf662 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] HTTP exception thrown: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7c83ed16-1900-4afe-9c4b-0470f2caf662 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Request method failure captured: Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: DELETE /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 HTTP/1.1 Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy5hsGlYlY7ln9Iwr_YI_JNR9wS0sOlmo0IVTQYHiFQt2cFHwoQ4bnxpEd79wINl0dEFdTm-7IhAg7SseMvP4cEGVGazP6QpOJEFva9_jQAoQ0lChl1TVCJcOWVgkY6rGAsgwbALOsZpsvOUbtree820qKlr_fbwZh8koIYaKgowIlE Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: e5b56cc9afe641ae8f21b59f77301f1e Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:48:35.816959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: e5b56cc9afe641ae8f21b59f77301f1e Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-VolumesSnapshotsTestJSON-915840289-project Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 9ba257f98cb64603a82b1c702659bbcd Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-VolumesSnapshotsTestJSON-915840289-project Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'd0ab717f-2a80-4f15-99a9-157a3d9dcda3'} Aug 31 09:48:35.819039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. (HTTP 404) (Request-ID: req-167f5b8f-e337-4230-9f08-7877ca7aa63d) Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:35.819790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 09:48:35.820687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 09:48:35.823785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.825722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7c83ed16-1900-4afe-9c4b-0470f2caf662 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Returning 404 to user: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:35.830755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7c83ed16-1900-4afe-9c4b-0470f2caf662 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3" status: 404 len: 109 microversion: 2.1 time: 0.176260 Aug 31 09:48:35.830755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 17/34] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:48:35 2022] DELETE /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 => generated 109 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:35.859268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-619a8a66-3cc9-4fa8-9154-035e3b1f83a2 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Calling method '.version_select at 0x7f9463915ee0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:35.932861 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-619a8a66-3cc9-4fa8-9154-035e3b1f83a2 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] HTTP exception thrown: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-619a8a66-3cc9-4fa8-9154-035e3b1f83a2 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Request method failure captured: Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 HTTP/1.1 Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy5hsGlYlY7ln9Iwr_YI_JNR9wS0sOlmo0IVTQYHiFQt2cFHwoQ4bnxpEd79wINl0dEFdTm-7IhAg7SseMvP4cEGVGazP6QpOJEFva9_jQAoQ0lChl1TVCJcOWVgkY6rGAsgwbALOsZpsvOUbtree820qKlr_fbwZh8koIYaKgowIlE Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: e5b56cc9afe641ae8f21b59f77301f1e Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:48:35.935946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e5b56cc9afe641ae8f21b59f77301f1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: e5b56cc9afe641ae8f21b59f77301f1e Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-915840289 Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-VolumesSnapshotsTestJSON-915840289-project Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 9ba257f98cb64603a82b1c702659bbcd Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-VolumesSnapshotsTestJSON-915840289-project Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'd0ab717f-2a80-4f15-99a9-157a3d9dcda3'} Aug 31 09:48:35.937022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. (HTTP 404) (Request-ID: req-3722a4a5-b3fd-45e3-bf86-a465c732efe9) Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:35.937644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 09:48:35.938938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 09:48:35.940665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-619a8a66-3cc9-4fa8-9154-035e3b1f83a2 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] Returning 404 to user: Volume d0ab717f-2a80-4f15-99a9-157a3d9dcda3 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-619a8a66-3cc9-4fa8-9154-035e3b1f83a2 tempest-VolumesSnapshotsTestJSON-915840289 tempest-VolumesSnapshotsTestJSON-915840289-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3" status: 404 len: 109 microversion: 2.1 time: 0.105017 Aug 31 09:48:35.942375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 18/35] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:48:35 2022] GET /compute/v2.1/os-volumes/d0ab717f-2a80-4f15-99a9-157a3d9dcda3 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:37.390271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:37.391168 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:37.391505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:37.392169 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:37.392813 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:37.429004 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:37.429770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:37.430437 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:37.431509 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:37.432273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:37.433014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:37.524446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Getting quotas for project bfef7bc61a644c12a42cc17b1aed1b31. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:37.558500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Getting quotas for user b8818863a81b4238a22035fbb256568e and project bfef7bc61a644c12a42cc17b1aed1b31. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:37.595735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:37.602839 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:37.841023 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2305549a-9cfe-4c5e-8bd5-8fac01b00edc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.818382 Aug 31 09:48:37.856660 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 18/36] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:48:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 4836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:48:37.869090 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a4b7ccd0-2868-4bca-bfc1-91c1817b409f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:37.869955 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a4b7ccd0-2868-4bca-bfc1-91c1817b409f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:38.236963 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a4b7ccd0-2868-4bca-bfc1-91c1817b409f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:38.272705 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a4b7ccd0-2868-4bca-bfc1-91c1817b409f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1222 microversion: 2.1 time: 0.414549 Aug 31 09:48:38.273267 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-902398545", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "networks": [{"uuid": "c5fa27f7-d2ea-4236-adda-4c8839534e18"}]}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:38.276052 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 19/37] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:37 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1222 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:38.546764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] validate_networks() for [('c5fa27f7-d2ea-4236-adda-4c8839534e18', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:48:38.607069 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-be04069a-10d7-46a6-9d15-8e22dac0de7c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'create', calling method: .version_select at 0x7f94638580d0>, body: {"keypair": {"name": "tempest-keypair-163004813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApl1WW7E5ep+HZutQXuZphfbx148pr88/A+TKgxiKXOMfc5tdO6lhESLujQviBLWXuj/dgnl4Fks67Ur2gBvKw9GJGpHJEEJouVnvhBRzWADFIlr2gpmMHviQ7fC3G78A=="}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:38.721110 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-be04069a-10d7-46a6-9d15-8e22dac0de7c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Getting quotas for project 568beb0822e640c1bacd98a2aec950ff. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:38.735406 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-be04069a-10d7-46a6-9d15-8e22dac0de7c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Getting quotas for user b6ca4276e1554d4184451313b2e09a88 and project 568beb0822e640c1bacd98a2aec950ff. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:38.884528 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-be04069a-10d7-46a6-9d15-8e22dac0de7c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.591330 Aug 31 09:48:38.896991 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 20/38] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:48:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:38.903780 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-492054589", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:39.281366 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.network.neutron [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] validate_networks() for [('d29a8f85-a955-420e-adfc-3d7c1f060852', None, None, None, None, None)] {{(pid=132570) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:48:39.720438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:39.721052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:39.721335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:39.721750 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:39.722173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:39.741125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:39.741748 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:39.745087 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:39.745798 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:39.746447 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:39.753381 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:39.818998 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Getting quotas for project 09f25e83fff24a8e924bb22e6f9fdd46. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:39.831209 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Getting quotas for user 8a3df25e740c4c7f8a311d5a1574c3ba and project 09f25e83fff24a8e924bb22e6f9fdd46. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:39.884025 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:39.895155 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:40.244819 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-cd47702a-5f0f-4320-b101-0d7384e1734f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.184499 Aug 31 09:48:40.247234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:48:41.412580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-cba834a6-d424-441c-803f-eae703dab868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: .version_select at 0x7f9462f81160>, body: {"keypair": {"name": "tempest-keypair-1705010575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0E7qfqUOMWmm12hi3QOoaK8IHYd9QECK9mKNaPGDClxz1a7NSTPnCf0Rjyv4pAb5cEDSjQEPgqwI0S4vopQmgNOzAIKv590LLl4TWE0fI6BckO4UgJ4JdbvXUIetU95A=="}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:41.505136 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-cba834a6-d424-441c-803f-eae703dab868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for project c4914faafb494e5bb323114853f25c54. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:41.530963 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-cba834a6-d424-441c-803f-eae703dab868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for user 980ab18eb5c646378d738079621a0dbc and project c4914faafb494e5bb323114853f25c54. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:41.746954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-cba834a6-d424-441c-803f-eae703dab868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.491157 Aug 31 09:48:41.766300 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:48:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:41.815582 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9604aadf-f68a-4ac5-bb5b-802eacf0eb09 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:41.821766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9604aadf-f68a-4ac5-bb5b-802eacf0eb09 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:42.461869 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9604aadf-f68a-4ac5-bb5b-802eacf0eb09 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:42.509948 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9604aadf-f68a-4ac5-bb5b-802eacf0eb09 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1214 microversion: 2.1 time: 0.741171 Aug 31 09:48:42.518743 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 21/41] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:41 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1214 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:43.560392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:43.561405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:43.581261 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:43.584612 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:43.586185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:43.589443 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:43.590756 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:43.591930 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.250783 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Flavor limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:44.253079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Image limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:44.253079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Flavor pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:44.253256 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Image pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:44.254090 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:44.305666 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.312989 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.313951 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.315354 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:44.316196 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:44.316946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:44.416357 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:44.491732 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3334864a-43e9-494b-a8ab-d2e9e74c8ed7 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1266 microversion: 2.1 time: 0.927382 Aug 31 09:48:44.496513 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 22/42] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:43 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1266 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:44.507836 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Getting quotas for project bfef7bc61a644c12a42cc17b1aed1b31. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:44.559946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Getting quotas for user b8818863a81b4238a22035fbb256568e and project bfef7bc61a644c12a42cc17b1aed1b31. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:44.621122 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Going to run 1 instances... {{(pid=132570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:44.625493 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:44.819842 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6151950b-98f1-4973-abb5-cbcfdc331d2a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.918759 Aug 31 09:48:44.820573 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 21/43] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:48:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 5923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:48:44.837340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2173852c-07f4-465e-8816-434b83125116 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:44.838147 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2173852c-07f4-465e-8816-434b83125116 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:45.117159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-2173852c-07f4-465e-8816-434b83125116 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:45.125927 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2173852c-07f4-465e-8816-434b83125116 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1221 microversion: 2.1 time: 0.293928 Aug 31 09:48:45.153408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 23/44] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:44 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1221 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:45.538831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:45.539949 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:45.580881 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:45.592018 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:45.592822 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:45.597443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:45.598292 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:45.599105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:46.157783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6487ef9e-c75c-49c7-8c46-b555a6d40747 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:46.163411 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6487ef9e-c75c-49c7-8c46-b555a6d40747 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:46.753906 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:46.840847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6487ef9e-c75c-49c7-8c46-b555a6d40747 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:46.858291 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6487ef9e-c75c-49c7-8c46-b555a6d40747 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1221 microversion: 2.1 time: 0.706638 Aug 31 09:48:46.859115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 24/45] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:46 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1221 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:46.873761 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-839e63d8-2ecd-4696-aec3-cc89c8fba96b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1266 microversion: 2.1 time: 1.340910 Aug 31 09:48:46.881756 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 22/46] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:45 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1266 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:47.897935 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:47.898730 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:47.930990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.931549 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:47.933507 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.935467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.936746 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:47.939974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.942864 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.943440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:47.992039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:47.996642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:47.998685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:48.004901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:48.007242 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:48.011022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:48.209601 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:48.218701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4a15e611-8bfe-4ca3-916d-e897b4ca12f6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1272 microversion: 2.1 time: 0.299201 Aug 31 09:48:48.220017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 23/47] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:47 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1272 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:48.228038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1284497697", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34569f52-bec4-4bad-9064-e6a8ffff260a"}], "security_groups": [{"name": "tempest-securitygroup--1111960861"}], "key_name": "tempest-keypair-163004813", "user_data": "}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:48.387366 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.network.neutron [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] validate_networks() for [('34569f52-bec4-4bad-9064-e6a8ffff260a', None, None, None, None, None)] {{(pid=132570) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:48:49.592872 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:49.617362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ca77cf98-60cc-44cc-8c59-177a64f10bf3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1273 microversion: 2.1 time: 1.724093 Aug 31 09:48:49.626151 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 25/48] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:47 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1273 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:49.644750 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:49.652052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:49.690787 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:49.692619 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:49.693712 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:49.705994 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:49.707352 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:49.715329 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:49.832423 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=4 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:50.123718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:50.147043 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0f054575-269b-426d-bcff-b69cc87e429b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1272 microversion: 2.1 time: 0.515563 Aug 31 09:48:50.148124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 26/49] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:49 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1272 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:50.348688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Flavor limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:50.350592 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Image limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:50.352142 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Flavor pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:50.352796 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Image pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:50.353512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:50.374948 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:50.376126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:50.376978 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:50.378735 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:50.379689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:50.381266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:50.431473 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Getting quotas for project 568beb0822e640c1bacd98a2aec950ff. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:50.444145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Getting quotas for user b6ca4276e1554d4184451313b2e09a88 and project 568beb0822e640c1bacd98a2aec950ff. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:50.496941 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Going to run 1 instances... {{(pid=132570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:50.509610 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:50.656968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:50.658706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:50.665838 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:50.670625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:50.671535 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:50.672553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:50.673258 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:50.673929 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:50.678154 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d1882908-81d0-48e2-ab2d-6e6cab705498 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.454875 Aug 31 09:48:50.680439 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 24/50] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:48:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:48:50.701255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8c1e8406-c607-4c1e-b7fc-bf131925e20c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:50.703079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8c1e8406-c607-4c1e-b7fc-bf131925e20c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:50.929456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8c1e8406-c607-4c1e-b7fc-bf131925e20c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:50.971105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8c1e8406-c607-4c1e-b7fc-bf131925e20c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1237 microversion: 2.1 time: 0.282378 Aug 31 09:48:50.985550 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 25/51] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:50 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1237 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:51.140840 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:51.182173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b5104400-a84d-4276-a02d-312b34efa88e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1279 microversion: 2.1 time: 0.526241 Aug 31 09:48:51.183724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 27/52] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:50 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1279 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:51.183842 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:51.184360 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:51.201575 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:51.202602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:51.203300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:51.204418 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:51.205088 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:51.205732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:51.381943 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:51.407735 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1d44973d-a47b-43a1-80e5-413862a5bced tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1272 microversion: 2.1 time: 0.226339 Aug 31 09:48:51.412299 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 26/53] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:51 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1272 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:52.028813 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:52.031052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:52.045815 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.047114 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.049021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.051001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.053772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.072324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.245804 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:52.267850 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:52.281728 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.283034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.284595 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.286852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.288105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.288932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.401993 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:52.417447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-245160fb-acca-43f6-9160-135f4fff4c1d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1279 microversion: 2.1 time: 0.200291 Aug 31 09:48:52.429263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 27/54] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:52 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:52.450682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:52.451473 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:52.471599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.472378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.472946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.477481 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:52.478301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:52.481006 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:52.489580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:52.498341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6af7d8be-b5b7-49a8-895c-cc92e32e940f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1241 microversion: 2.1 time: 0.479172 Aug 31 09:48:52.498946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 28/55] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:52 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1241 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:53.085220 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:53.186415 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fd7be99b-02a5-44e1-baf3-1d6f4f578ff0 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.734081 Aug 31 09:48:53.190382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 28/56] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:52 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:53.370429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-391135877", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5fb2c2c-d2a5-4039-a42c-96d968ac091e"}], "security_groups": [{"name": "tempest-securitygroup--1553436604"}], "key_name": "tempest-keypair-1705010575", "user_data": "}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:53.469714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:53.470417 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:53.494529 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:53.499419 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:53.500040 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:53.503081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:53.517565 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:53.523298 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:53.937976 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] validate_networks() for [('c5fb2c2c-d2a5-4039-a42c-96d968ac091e', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:48:54.187105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:54.221544 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a71ec1cc-8cf3-4391-8a8f-49fdd04218b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1279 microversion: 2.1 time: 0.757674 Aug 31 09:48:54.233413 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 29/57] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:53 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1279 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:54.248379 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:54.250441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:54.279261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:54.282201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:54.283080 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:54.284148 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:54.285809 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:54.287736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:55.890680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:55.901702 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2462ba32-760e-4792-ac14-c4c298eede63 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1289 microversion: 2.1 time: 1.672816 Aug 31 09:48:55.919194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 30/58] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:54 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1289 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:55.919194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:55.919194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:55.935697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:55.938477 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:55.939460 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:55.940410 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:55.943951 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:55.944733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:56.845055 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=22 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:57.379456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:48:57.380444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:48:57.381368 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:48:57.381923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:48:57.382789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:48:57.384626 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:57.394370 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.394890 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.395561 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.397995 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.398720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.398859 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-90a4caff-74b9-416d-986f-2008ef6f0550 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 1.491874 Aug 31 09:48:57.399551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.399777 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 31/59] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:55 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:57.412623 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:57.413504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:57.429029 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.429817 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.430432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.436676 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for project c4914faafb494e5bb323114853f25c54. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:48:57.436885 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.437390 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.437843 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.445827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for user 980ab18eb5c646378d738079621a0dbc and project c4914faafb494e5bb323114853f25c54. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:48:57.467146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:48:57.470347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:48:57.610361 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e03e425d-2190-4ac6-9248-35cad7e27e2e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.244329 Aug 31 09:48:57.618642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 29/60] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:48:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 4246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:48:57.625478 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:57.626639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:57.637450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.638316 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.638965 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.641637 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:57.642411 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:57.643007 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:57.752114 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:57.782068 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8a3ccd48-9c7e-4570-99a4-42cba12177aa tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.381156 Aug 31 09:48:57.783528 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 32/61] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:57 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:57.796083 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9994b48f-c5a4-45c2-9c3f-66940910c8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:57.803895 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9994b48f-c5a4-45c2-9c3f-66940910c8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:58.064970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9994b48f-c5a4-45c2-9c3f-66940910c8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:58.090039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9994b48f-c5a4-45c2-9c3f-66940910c8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1241 microversion: 2.1 time: 0.303966 Aug 31 09:48:58.091077 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 33/62] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:57 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1241 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:58.195969 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:58.210996 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-18946862-fbc8-42de-aaa5-39fc1f9f79ab tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.589719 Aug 31 09:48:58.211981 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 30/63] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:57 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:58.438135 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:58.439191 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:58.447598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=7 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:58.458712 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:58.459647 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:58.460377 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:58.461389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:58.462264 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:58.463199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:58.821168 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:58.822366 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:58.831822 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:58.840246 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:58.844183 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:58.848199 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:58.852946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:58.853966 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e058ba35-1cf0-457f-b976-ab3878a0bf36 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.420349 Aug 31 09:48:58.854640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:58.855261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 34/64] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:58 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:58.855772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.118764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:59.119430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:59.138572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.139069 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.139680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.140432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.140897 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.141324 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.288434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:59.297886 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d5924beb-058e-46a4-8d5a-482ee17ffc56 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1245 microversion: 2.1 time: 0.185078 Aug 31 09:48:59.299087 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 35/65] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:59 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1245 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:59.304441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:59.305278 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:59.323344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.325384 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.327385 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.330140 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.331067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.331987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.435058 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:59.448264 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=47 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:59.453489 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-382c6182-1f6e-4fe9-93a0-b378c8df2394 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.636755 Aug 31 09:48:59.469605 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 31/66] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:58 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:48:59.485183 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:48:59.504266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-bfc80ad8-2e47-4782-9f6e-ed3376e887eb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.203116 Aug 31 09:48:59.505950 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 36/67] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:59 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:48:59.590977 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-d15183c4-8fd2-465b-902a-36268e96c28e req-7b9595b2-626b-4054-ac29-aaefeba606b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78c94c0f-080d-4a60-8eb9-55ec8270ffef", "tag": "3bf52432-0f69-4762-9ab5-38cfb050a75d"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:48:59.601559 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=10 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:59.621009 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d15183c4-8fd2-465b-902a-36268e96c28e req-7b9595b2-626b-4054-ac29-aaefeba606b5 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.628604 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d15183c4-8fd2-465b-902a-36268e96c28e req-7b9595b2-626b-4054-ac29-aaefeba606b5 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.630700 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d15183c4-8fd2-465b-902a-36268e96c28e req-7b9595b2-626b-4054-ac29-aaefeba606b5 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.754074 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-d15183c4-8fd2-465b-902a-36268e96c28e req-7b9595b2-626b-4054-ac29-aaefeba606b5 service nova] Creating event network-changed:3bf52432-0f69-4762-9ab5-38cfb050a75d for instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef on hv-cinder-83754 Aug 31 09:48:59.757737 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d15183c4-8fd2-465b-902a-36268e96c28e req-7b9595b2-626b-4054-ac29-aaefeba606b5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 09:48:59.759502 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d15183c4-8fd2-465b-902a-36268e96c28e req-7b9595b2-626b-4054-ac29-aaefeba606b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 09:48:59.765045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d75fa44-d275-481b-bb6c-cd951a0cd46d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.767918 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d75fa44-d275-481b-bb6c-cd951a0cd46d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.771414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d75fa44-d275-481b-bb6c-cd951a0cd46d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.772934 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d75fa44-d275-481b-bb6c-cd951a0cd46d None None] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.776041 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d75fa44-d275-481b-bb6c-cd951a0cd46d None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.776787 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d75fa44-d275-481b-bb6c-cd951a0cd46d None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.805848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.compute.rpcapi [None req-7d75fa44-d275-481b-bb6c-cd951a0cd46d None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 09:48:59.806776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d75fa44-d275-481b-bb6c-cd951a0cd46d None None] Releasing lock "compute-rpcapi-router" {{(pid=132571) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 09:48:59.854667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7d75fa44-d275-481b-bb6c-cd951a0cd46d None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.381402 Aug 31 09:48:59.855361 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 32/68] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:48:59.899851 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:48:59.900980 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:48:59.975465 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.976366 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:48:59.977146 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:48:59.988871 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:48:59.992018 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:00.003681 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:00.339461 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:00.341848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:00.381832 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:00.402233 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=4 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:00.405492 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:00.406856 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:00.415467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:00.416587 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:00.429937 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:00.775302 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:00.825140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-71a185e8-07d9-45bc-a5d5-78dd898f2479 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1245 microversion: 2.1 time: 0.500170 Aug 31 09:49:00.833419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 33/69] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:00 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1245 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:00.855748 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:00.856708 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:00.870439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:00.875482 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:00.876500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:00.877748 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:00.878701 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:00.879417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.268495 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:01.293898 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3cf900ea-9768-4f01-8fbe-e036cfe4c34f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.458464 Aug 31 09:49:01.305419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 34/70] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:00 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:01.328383 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:01.329698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:01.341745 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.342874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.343984 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.345500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.346623 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.348094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.525248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:01.544988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bd021498-ff9b-43ca-b66e-3528959b77f1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.237142 Aug 31 09:49:01.546810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 35/71] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:01 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:01.667588 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:01.684184 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3071938c-5ad0-4242-83f0-25e185be7726 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 1.795213 Aug 31 09:49:01.686026 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 37/72] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:48:59 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:01.858855 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:01.860189 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:01.867962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.868701 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.869285 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.870180 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:01.870785 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:01.871465 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:01.974273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:01.985479 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-84732805-0386-45a2-a584-d5b27509539d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1245 microversion: 2.1 time: 0.130351 Aug 31 09:49:01.987432 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 36/73] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:01 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:02.019506 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-5fd8e0d9-74d7-42ab-8b37-54156a5f2f12 req-82cddb28-4ad1-4ccc-a29e-f79324717a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52ff3858-3242-45d8-ad69-757d5b9c6d7c", "tag": "6f61b202-be56-46f9-938f-4a4424b4710e"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:02.036315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-5fd8e0d9-74d7-42ab-8b37-54156a5f2f12 req-82cddb28-4ad1-4ccc-a29e-f79324717a5a service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.037204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-5fd8e0d9-74d7-42ab-8b37-54156a5f2f12 req-82cddb28-4ad1-4ccc-a29e-f79324717a5a service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.037884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-5fd8e0d9-74d7-42ab-8b37-54156a5f2f12 req-82cddb28-4ad1-4ccc-a29e-f79324717a5a service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.066809 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-5fd8e0d9-74d7-42ab-8b37-54156a5f2f12 req-82cddb28-4ad1-4ccc-a29e-f79324717a5a service nova] Creating event network-changed:6f61b202-be56-46f9-938f-4a4424b4710e for instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c on hv-cinder-83754 Aug 31 09:49:02.069144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-5fd8e0d9-74d7-42ab-8b37-54156a5f2f12 req-82cddb28-4ad1-4ccc-a29e-f79324717a5a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 09:49:02.072763 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-5fd8e0d9-74d7-42ab-8b37-54156a5f2f12 req-82cddb28-4ad1-4ccc-a29e-f79324717a5a service nova] Acquired lock "compute-rpcapi-router" {{(pid=132570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 09:49:02.074857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-94a5e243-7135-4f56-8242-a5a6dc1ddc1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.076614 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-94a5e243-7135-4f56-8242-a5a6dc1ddc1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.077533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-94a5e243-7135-4f56-8242-a5a6dc1ddc1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.078730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-94a5e243-7135-4f56-8242-a5a6dc1ddc1b None None] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.079517 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-94a5e243-7135-4f56-8242-a5a6dc1ddc1b None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.080430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-94a5e243-7135-4f56-8242-a5a6dc1ddc1b None None] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.100430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.compute.rpcapi [None req-94a5e243-7135-4f56-8242-a5a6dc1ddc1b None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 09:49:02.102169 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-94a5e243-7135-4f56-8242-a5a6dc1ddc1b None None] Releasing lock "compute-rpcapi-router" {{(pid=132570) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 09:49:02.133264 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-94a5e243-7135-4f56-8242-a5a6dc1ddc1b None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118121 Aug 31 09:49:02.134278 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 38/74] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:02.331371 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:02.332521 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:02.346540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.347492 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.348293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.350171 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.351017 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.352418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.582081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:02.585349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:02.608488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.609039 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:02.610407 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.610951 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.614838 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.615471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.616000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.639793 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f0af76e8-132f-4929-8a91-151683f9cb23 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.313821 Aug 31 09:49:02.644399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 37/75] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:02 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:02.726597 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:02.727714 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:02.739057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.739894 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.740503 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.742224 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:02.743051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:02.743758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:02.760891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:02.777816 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6390e5d8-80a3-4726-8d6a-191855519eee tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.208922 Aug 31 09:49:02.778863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 39/76] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:02 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:02.917651 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:02.929001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8d8ce352-88f6-46e2-ae5a-925deeac8499 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.207817 Aug 31 09:49:02.930035 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 38/77] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:02 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:03.021408 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:03.022543 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:03.038996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.040718 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.041818 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.043465 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.047314 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.050197 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.360120 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:03.370764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dbc53236-8ced-405a-a036-dba8bf76655c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1245 microversion: 2.1 time: 0.356115 Aug 31 09:49:03.372148 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 40/78] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:03 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1245 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:03.687012 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:03.688021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:03.700045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.702472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.704472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.707455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.712243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.713951 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.818387 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:03.819022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:03.830805 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.840753 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.841403 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.842046 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:03.842511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:03.842942 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:03.912393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:03.979723 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:03.989944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e265c531-4a91-4459-b70d-a69990ce005e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.175689 Aug 31 09:49:04.001561 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 41/79] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:03 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:04.008452 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:04.009074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:04.016134 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.016721 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.017275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.018023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.018544 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.018988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.340619 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:04.354470 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ba2e9529-cfcf-4a7d-ab6f-94bb1fb5297b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.671593 Aug 31 09:49:04.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 39/80] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:03 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:04.410222 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:04.411712 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:04.438858 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.440949 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.444140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.446713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.451916 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.454422 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.535681 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:04.553740 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-abb67940-e4f9-4d7e-8d93-29bd9fad91cd tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.550230 Aug 31 09:49:04.556003 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 42/81] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:04 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:04.685444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:04.698953 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0ac592cc-e07b-4b08-8b50-c6c276f4823a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1245 microversion: 2.1 time: 0.292538 Aug 31 09:49:04.701032 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 40/82] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:04 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1245 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:04.800857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-f028eb3b-c993-4d9f-8633-72d4515dfea3 req-0ec63ade-bd0c-487e-8b0c-068b85a4897f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44963711-215e-4aca-bdfb-7d22be495691", "tag": "3e4253e5-5b4e-4671-ad15-d6b2b34c4cba"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:04.818644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-f028eb3b-c993-4d9f-8633-72d4515dfea3 req-0ec63ade-bd0c-487e-8b0c-068b85a4897f service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:04.820265 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-f028eb3b-c993-4d9f-8633-72d4515dfea3 req-0ec63ade-bd0c-487e-8b0c-068b85a4897f service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:04.821261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-f028eb3b-c993-4d9f-8633-72d4515dfea3 req-0ec63ade-bd0c-487e-8b0c-068b85a4897f service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:04.835946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-f028eb3b-c993-4d9f-8633-72d4515dfea3 req-0ec63ade-bd0c-487e-8b0c-068b85a4897f service nova] Creating event network-changed:3e4253e5-5b4e-4671-ad15-d6b2b34c4cba for instance 44963711-215e-4aca-bdfb-7d22be495691 on hv-cinder-83754 Aug 31 09:49:04.843370 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-f028eb3b-c993-4d9f-8633-72d4515dfea3 req-0ec63ade-bd0c-487e-8b0c-068b85a4897f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.285290 Aug 31 09:49:04.843977 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 43/83] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:05.016118 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:05.017140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:05.027332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.027842 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.028287 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.029020 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.029484 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.029913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.128916 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:05.138370 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8040554e-bea9-452d-8c0b-28096e6ae769 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.129228 Aug 31 09:49:05.139240 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 41/84] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:05 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:05.396412 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:05.397313 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:05.405426 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.405892 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.406643 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.407852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.408071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.408493 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.588599 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:05.591840 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:05.607285 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.609023 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.609966 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.613050 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.614452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.616813 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.649239 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:05.672267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-30522125-66cc-416a-a6ee-110d6401e863 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.281867 Aug 31 09:49:05.686131 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 44/85] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:05 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:05.724649 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:05.725271 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:05.737352 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.741008 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.741486 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.742513 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:05.743831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:05.744826 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:05.864377 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:05.875033 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7465edf5-bab2-47f9-af92-5eb01ce27206 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1245 microversion: 2.1 time: 0.154503 Aug 31 09:49:05.877371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 45/86] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:05 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1245 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:05.898189 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:05.915756 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b250de70-191b-4a1a-9103-b0a247ca6a1e tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.342198 Aug 31 09:49:05.923505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 42/87] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:05 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:06.173389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:06.176835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:06.186438 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.186985 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.187514 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.188391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.188914 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.189403 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.308336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:06.321042 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-42528943-6c04-4e9b-8d47-078d8ed50151 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.151388 Aug 31 09:49:06.321668 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 46/88] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:06 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:06.695263 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:06.696503 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:06.711440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.712240 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.712901 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.713882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.716209 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.719445 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.938878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:06.939844 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:06.964991 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.969937 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.972338 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:06.975332 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:06.980265 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:06.981543 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.196248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:07.212819 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-de243ee5-7b45-48a0-a7bd-fbfa3b3e56a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.522254 Aug 31 09:49:07.216148 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 43/89] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:06 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:07.243496 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:07.245791 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:07.259173 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:07.262840 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.263790 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.264497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.266180 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.267622 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.268241 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.274103 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-22b05db9-d9ac-4ad2-bfef-9847b95f65e4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1245 microversion: 2.1 time: 0.359033 Aug 31 09:49:07.275857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 47/90] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:06 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1245 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:07.358117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:07.360242 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:07.374345 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.377323 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.378721 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.380658 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:07.381937 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:07.383028 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:07.459677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=6 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:07.527201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:07.542279 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-890e3691-af1b-4b18-9207-68f4ab9d6654 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.198990 Aug 31 09:49:07.543242 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 48/91] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:07 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:07.584656 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:07.601318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-45873337-afdc-48a8-b7d6-cd60638f100b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.383108 Aug 31 09:49:07.602559 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 44/92] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:07 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:08.255963 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:08.257174 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:08.259462 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=22 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:08.266472 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.267901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.268546 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.269624 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.270111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.270704 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.315416 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:08.317598 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:08.332660 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.334582 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.336968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.339088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.340455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.341618 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.449107 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:08.460147 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-080d0513-0e75-4f27-b981-d6d96b702daa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1245 microversion: 2.1 time: 0.148662 Aug 31 09:49:08.461120 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 45/93] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:08 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1245 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:08.502269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:08.518566 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ea69fc5c-eed9-4219-a6d4-256e686f7d2d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.267475 Aug 31 09:49:08.520164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 49/94] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:08 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:08.582188 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:08.583461 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:08.591637 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.592279 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.592844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.593694 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.594310 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.595085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.636607 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:08.637523 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:08.644032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.644833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.645648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.646605 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:08.647290 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:08.647917 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:08.712056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:08.740224 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e71e849c-eb05-47a2-8bdd-fc609cbf7f7b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.164984 Aug 31 09:49:08.747226 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 46/95] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:08 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:08.833536 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:08.850293 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-16279594-f437-4a17-aad8-3c34a41bd3ed tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.217111 Aug 31 09:49:08.851784 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 50/96] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:08 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:09.487523 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:09.490453 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:09.502068 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.503496 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.504999 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.524251 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.525300 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.529978 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.550094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:09.551487 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:09.558356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.558882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.559364 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.560762 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.561529 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.562240 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.702048 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:09.739718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f8612511-a73c-41ea-9487-2acb2991ea0b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1245 microversion: 2.1 time: 0.254826 Aug 31 09:49:09.741789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 47/97] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:09 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1245 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:09.781216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:09.782984 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:09.797413 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=4 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:09.799805 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.802639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.805941 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.807162 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:09.807887 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:09.808536 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:09.986773 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:10.011475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ab432b36-5e9c-4f67-9abb-3e0a75408ba2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.465443 Aug 31 09:49:10.024407 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 51/98] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:09 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:10.043570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:10.060106 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:10.063328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:10.067712 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=100 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:10.081105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d3a4301e-6dfb-4a8d-8923-5fe73460ba22 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.304658 Aug 31 09:49:10.089301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.091338 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.093091 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 48/99] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:09 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:10.109398 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.112146 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.114522 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.116459 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.402978 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:10.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1d68137f-1de6-48fe-8252-b3be5b99bda5 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.364867 Aug 31 09:49:10.414419 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 52/100] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:10 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:10.778110 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:10.779646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:10.793330 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.793954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.806466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:10.816828 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:10.821258 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:10.825885 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.047852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:11.050659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:11.100117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.101329 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.102228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.104346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.107663 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.110760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.636718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:11.647887 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-cf4f2e8c-91ea-4dc7-af19-5ab9bddd041e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1237 microversion: 2.1 time: 0.873899 Aug 31 09:49:11.653696 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 49/101] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:10 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1237 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:11.669447 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:11.672648 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:11.685653 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.688023 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.698659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.699928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:11.700636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:11.704018 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:11.952991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:12.000666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-dad6198b-4d45-4473-ad32-674c78cc108f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.345518 Aug 31 09:49:12.014466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 50/102] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:11 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:12.039146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:12.042223 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:12.053408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:12.054434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:12.055197 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:12.056320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:12.057297 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:12.057983 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:12.095409 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:12.166827 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:12.188411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a1d78c28-82f1-46ba-8941-6ac6c15b8b1a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 1.145644 Aug 31 09:49:12.196159 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 53/103] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:11 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:12.560029 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:12.576810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-34c4d565-3e07-4beb-823f-c36565c7e179 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.559493 Aug 31 09:49:12.578389 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 51/104] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:12 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:12.710760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:12.715378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:12.731476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:12.733266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:12.739222 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:12.741838 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:12.743395 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:12.746467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:12.841562 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:12.853779 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-388295f7-de37-4c8a-87d1-060a6e71b6b4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1293 microversion: 2.1 time: 0.162416 Aug 31 09:49:12.863172 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 54/105] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:12 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1293 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:13.045475 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:13.051005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:13.090801 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.092556 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.095161 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.099376 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.100563 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.102590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.227515 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:13.228670 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:13.239318 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.240412 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.241286 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.242570 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.243491 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.245264 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.319337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:13.349882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ada11f68-9d64-4c87-a0e2-01398c9d0a56 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1295 microversion: 2.1 time: 0.311032 Aug 31 09:49:13.351868 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 52/106] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:13 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1295 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:13.597722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:13.609012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c8b5cfc5-6d9c-46ff-9f8e-47266c69bce7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.389496 Aug 31 09:49:13.609611 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 55/107] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:13 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:13.631881 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:13.632851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:13.651541 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.652527 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.653211 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.654002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.654895 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.655862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.891544 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:13.892161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:13.911654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.912895 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.913607 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.915101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:13.916262 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:13.917166 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:13.967218 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:13.977667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-cbaff9ac-aee4-4a7d-b2ec-48c06c957df1 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.351356 Aug 31 09:49:13.978258 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 53/108] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:13 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:14.030374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:14.040793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9022554e-94fc-49ec-8cec-fa8f68368274 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1301 microversion: 2.1 time: 0.153032 Aug 31 09:49:14.041502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 56/109] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:13 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1301 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:14.391943 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:14.393205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:14.403577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.404570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.405484 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.406841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.407833 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.408709 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.636051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:14.636586 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:14.637098 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:14.644841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-37527d51-00f5-4f4d-8ed8-3312ed691b75 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.259376 Aug 31 09:49:14.646326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 54/110] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:14 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:14.647381 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.648238 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.649072 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.649860 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:14.650343 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:14.650764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:14.843848 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:14.852617 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4e2b25d6-c77b-4e1d-98c8-c10eb7f09e4d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.222689 Aug 31 09:49:14.853247 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 57/111] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:14 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:14.999419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.000494 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.010890 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.011796 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.012274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.012992 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.013467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.013872 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.078812 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.079864 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.094117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.094702 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.095465 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.096513 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.097385 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.098001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.133644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:15.212141 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:15.224043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-deea42f6-781c-428e-9829-88a6ab93f65a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1301 microversion: 2.1 time: 0.150557 Aug 31 09:49:15.225073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 58/112] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:15 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1301 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:15.241755 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:15.256050 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e95bf032-dbae-4c8d-aa5a-e0c60675f670 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.260947 Aug 31 09:49:15.257005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 55/113] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:14 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:15.672336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.673389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.684415 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.685814 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.686849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.688393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.689422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.690365 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.882031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:15.886567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:15.922773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.924082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.925052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:15.926992 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:15.928100 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:15.929064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:16.385041 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:16.437022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6769a1e5-5fff-49ce-9687-232e26c094a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.772331 Aug 31 09:49:16.462682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 59/114] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:15 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:16.487299 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:16.489234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:16.514571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:16.517863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:16.520306 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:16.523794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:16.524617 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:16.528470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:16.770613 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:16.786033 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1ca77f8a-c815-4b6b-9e8f-c3d8aeb4f295 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1299 microversion: 2.1 time: 0.320663 Aug 31 09:49:16.804412 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 60/115] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:16 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1299 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:16.838904 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:16.841048 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:16.856003 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:16.857383 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:16.858537 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:16.860263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:16.861458 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:16.862514 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:17.358974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:17.389055 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d2a50553-67e4-4529-82df-3dbe92339291 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 1.506934 Aug 31 09:49:17.389055 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 56/116] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:15 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:17.466574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:17.474843 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-02544479-a161-43d2-aa8d-ef3a70a617af tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.668567 Aug 31 09:49:17.476698 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 61/117] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:16 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:17.514804 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:17.520804 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:17.578758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:17.588738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:17.588738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:17.588738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:17.588738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:17.589330 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:17.838233 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:17.846353 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:17.855440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:17.856141 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:17.856685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:17.857516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:17.858369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:17.859640 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.405882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:18.417891 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8a0ec575-062a-48e7-94b7-baa1b9db618d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.911782 Aug 31 09:49:18.421871 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 57/118] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:17 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:18.432364 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:18.433465 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:18.454057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:18.454954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:18.455792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.465920 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:18.467635 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:18.468125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.674126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:18.698845 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-24ad3eb6-3819-45c0-984b-a54f4dcc3902 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.865889 Aug 31 09:49:18.728177 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 62/119] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:17 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:18.750535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:18.751920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:18.785199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:18.786709 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:18.787768 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:18.791903 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:18.793475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:18.794941 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.362732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:19.389017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dab0a2f3-9464-47c3-ad18-58f72c9c8614 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.648319 Aug 31 09:49:19.390787 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 63/120] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:18 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:19.402533 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:19.419974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-76f52725-76e0-4886-aef6-948b425188b2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.993717 Aug 31 09:49:19.422119 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 58/121] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:18 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:19.486156 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:19.487462 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:19.499568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.500688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.502360 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.504275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.505537 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.506479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.592231 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-c31bfc06-803f-4b2f-a6c3-79b26b8e6a99 req-9db6bdcf-12e8-4d89-b0a1-d8e4dfe0ace1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2795070d-ec5b-480c-91d5-f1317b74ea69", "tag": "a2b8c3ca-e7e6-4da8-a26d-11ed9ce5e3dc"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:19.623534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-c31bfc06-803f-4b2f-a6c3-79b26b8e6a99 req-9db6bdcf-12e8-4d89-b0a1-d8e4dfe0ace1 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.624205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-c31bfc06-803f-4b2f-a6c3-79b26b8e6a99 req-9db6bdcf-12e8-4d89-b0a1-d8e4dfe0ace1 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.627354 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-c31bfc06-803f-4b2f-a6c3-79b26b8e6a99 req-9db6bdcf-12e8-4d89-b0a1-d8e4dfe0ace1 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.650864 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-c31bfc06-803f-4b2f-a6c3-79b26b8e6a99 req-9db6bdcf-12e8-4d89-b0a1-d8e4dfe0ace1 service nova] Creating event network-changed:a2b8c3ca-e7e6-4da8-a26d-11ed9ce5e3dc for instance 2795070d-ec5b-480c-91d5-f1317b74ea69 on hv-cinder-83754 Aug 31 09:49:19.657381 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-c31bfc06-803f-4b2f-a6c3-79b26b8e6a99 req-9db6bdcf-12e8-4d89-b0a1-d8e4dfe0ace1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081445 Aug 31 09:49:19.658783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 59/122] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:19.751001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:19.751745 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:19.761143 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.761656 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.762089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.762850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:19.763342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:19.763927 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:19.837690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:19.864369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1bc0e33f-38ab-4903-96ea-b8dbb8a64043 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.383917 Aug 31 09:49:19.864369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 64/123] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:19 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:20.008089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:20.021684 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2b5599e0-e0f0-4840-92b4-9dcc33882d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.274445 Aug 31 09:49:20.029238 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 60/124] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:19 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:20.414034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:20.414783 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:20.422526 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.423229 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.423652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.424456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.424966 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.425419 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.462771 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:20.464362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:20.479067 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.480149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.481038 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.484564 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.486054 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.487843 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.675512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:20.692231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dfe4b060-09d8-43ce-a23b-f7dea5c612ae tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.282467 Aug 31 09:49:20.693478 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 65/125] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:20 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:20.705985 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:20.715053 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b13eff5e-5086-422b-93e2-06c6983cd05f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.260836 Aug 31 09:49:20.716297 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 61/126] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:20 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:20.900299 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:20.901056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:20.907887 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.908382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.909141 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:20.910013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:20.911437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:20.911867 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.047995 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:21.049680 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:21.062703 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.063606 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.064399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.065733 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.066586 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.067419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.076235 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:21.087875 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4019a896-9998-4bfa-8390-e3038ccf80d6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.193783 Aug 31 09:49:21.088761 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 66/127] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:20 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:21.243487 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:21.260455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a8de3720-7e0a-4909-90af-80c04a90e2c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.217354 Aug 31 09:49:21.261457 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 62/128] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:21 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:21.754757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:21.758266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:21.761399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:21.771110 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:21.794385 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.795618 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.799424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.802349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.804625 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.805934 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.814685 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.815311 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.815938 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:21.832873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:21.833817 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:21.835216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.173904 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:23.192489 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7b9a408c-b4d9-4fd4-a762-49fa9533f501 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 1.462892 Aug 31 09:49:23.195281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 67/129] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:21 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:23.201926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:23.207822 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:23.222550 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.223981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.224628 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.225571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.226247 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.226976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.328028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:23.340862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-42b7854e-aedf-4735-85fe-3ea9cad85e09 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 1.591967 Aug 31 09:49:23.341526 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 63/130] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:21 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:23.354249 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:23.354875 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:23.378150 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.378939 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.380014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.381003 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:23.381636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:23.382641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:23.797033 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:23.817295 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d858d012-307a-48bd-be90-7439eb7cd13a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.618588 Aug 31 09:49:23.818029 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 68/131] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:23 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:23.835908 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:23.852308 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-72ecedfc-321f-4b8a-ae10-7774ae3ea8bb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.509143 Aug 31 09:49:23.854081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 64/132] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:23 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:24.191105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-a9cf5533-5e0e-4565-9261-87a5fdb75f64 req-6229a937-3788-43e9-bc19-7c6b3a42f706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84e69de-d263-47c5-a190-3e39a8087f17", "tag": "f2a2ff95-6baf-4704-b5e9-844a4a2195ce"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:24.205787 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-a9cf5533-5e0e-4565-9261-87a5fdb75f64 req-6229a937-3788-43e9-bc19-7c6b3a42f706 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.206263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-a9cf5533-5e0e-4565-9261-87a5fdb75f64 req-6229a937-3788-43e9-bc19-7c6b3a42f706 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.207022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-a9cf5533-5e0e-4565-9261-87a5fdb75f64 req-6229a937-3788-43e9-bc19-7c6b3a42f706 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.220655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:24.221567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:24.224823 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-a9cf5533-5e0e-4565-9261-87a5fdb75f64 req-6229a937-3788-43e9-bc19-7c6b3a42f706 service nova] Creating event network-changed:f2a2ff95-6baf-4704-b5e9-844a4a2195ce for instance c84e69de-d263-47c5-a190-3e39a8087f17 on hv-cinder-83754 Aug 31 09:49:24.231400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-a9cf5533-5e0e-4565-9261-87a5fdb75f64 req-6229a937-3788-43e9-bc19-7c6b3a42f706 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045574 Aug 31 09:49:24.232557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 69/133] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:24.235597 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.236099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.236533 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.237462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.238151 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.239778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.365646 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:24.366776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:24.381188 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.383210 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.384692 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.388252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.389918 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.390875 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.535035 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:24.557189 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8f9f45f9-8931-4b2c-88a0-62be6430dbce tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.340448 Aug 31 09:49:24.558424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 65/134] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:24 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:24.676894 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:24.689074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-650db7de-a85b-4b16-a81f-a6a6aeba7b43 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.327920 Aug 31 09:49:24.689529 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 70/135] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:24 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:24.842047 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:24.842955 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:24.850583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.855761 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.857219 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.864320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.865195 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.865723 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.874390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=100 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:24.878116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:24.879034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:24.888877 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.889703 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.890535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:24.891882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:24.892655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:24.893254 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.161085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:25.174012 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f00005ab-271b-4807-a5bc-9acd9c706065 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.338936 Aug 31 09:49:25.174608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 66/136] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:24 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:25.251069 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:25.264927 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ea4f7e3a-f3df-4aa4-9830-b9b19cffcbbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.391013 Aug 31 09:49:25.268536 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 71/137] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:24 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:25.586880 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:25.587717 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:25.601011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.601545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.602116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.602823 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.603331 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.604018 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.619010 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-f5f9574d-81da-41c9-82e5-fd64cf50d4d3 req-5b0f70fa-1f14-4d9f-9758-41feba1fa134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c94c0f-080d-4a60-8eb9-55ec8270ffef", "name": "network-vif-plugged", "status": "completed", "tag": "3bf52432-0f69-4762-9ab5-38cfb050a75d"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:25.636563 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-f5f9574d-81da-41c9-82e5-fd64cf50d4d3 req-5b0f70fa-1f14-4d9f-9758-41feba1fa134 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.640214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-f5f9574d-81da-41c9-82e5-fd64cf50d4d3 req-5b0f70fa-1f14-4d9f-9758-41feba1fa134 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.641190 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-f5f9574d-81da-41c9-82e5-fd64cf50d4d3 req-5b0f70fa-1f14-4d9f-9758-41feba1fa134 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.659312 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-f5f9574d-81da-41c9-82e5-fd64cf50d4d3 req-5b0f70fa-1f14-4d9f-9758-41feba1fa134 service nova] Creating event network-vif-plugged:3bf52432-0f69-4762-9ab5-38cfb050a75d for instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef on hv-cinder-83754 Aug 31 09:49:25.668052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-f5f9574d-81da-41c9-82e5-fd64cf50d4d3 req-5b0f70fa-1f14-4d9f-9758-41feba1fa134 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156908 Aug 31 09:49:25.669028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 67/138] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:25.720449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:25.721161 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:25.734095 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.734594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.736048 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.743915 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:25.745182 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:25.745796 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:25.962114 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:25.979826 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f163b2bb-4dbe-4de6-a003-738f37b014ec tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.398679 Aug 31 09:49:25.980863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 72/139] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:25 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:26.211955 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:26.216740 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:26.253602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.257365 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.264029 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.271447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.271447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.271447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.540742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:26.587032 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-216d59b3-d072-4bae-a809-2786cec34fa8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.870516 Aug 31 09:49:26.591758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 68/140] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:25 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:26.617289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:26.618499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:26.641421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.643565 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.647900 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.649506 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:26.655050 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:26.656184 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:26.984280 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:27.004614 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dcd38b8b-018f-4205-af4a-3534865a7db1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.809836 Aug 31 09:49:27.005993 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 73/141] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:26 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:27.041707 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:27.043228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:27.069097 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:27.070806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:27.072285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:27.073422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:27.074105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:27.075059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:27.495980 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:27.506753 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:27.518595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b0cba8d6-2e23-4898-8456-b2b0c23a31c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.925246 Aug 31 09:49:27.523071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fc95a442-5d01-4ee4-a00c-4075cb152dbe tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.492924 Aug 31 09:49:27.527515 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 69/142] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:26 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:27.531109 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 74/143] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:27 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:27.611883 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:27.614932 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:27.625243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:27.625898 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:27.626498 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:27.627475 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:27.628387 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:27.629312 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:27.949606 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:27.959567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f50eb742-512e-4312-8003-9cfec30f2635 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.354065 Aug 31 09:49:27.960156 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 70/144] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:27 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:28.045095 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:28.046331 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:28.065981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.070003 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.071063 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.073732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.075017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.076411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.508774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:28.537395 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:28.569763 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:28.579773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:28.599043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a13ed1c1-f998-4a26-bc00-d6e5d8c15850 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.551999 Aug 31 09:49:28.601456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 75/145] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:28 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:28.622742 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:28.623385 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:28.632834 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=84 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:28.644069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.649477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.656450 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.656954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.657724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.658586 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.659543 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.660867 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.661455 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:28.668077 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:28.670303 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:28.676913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.087224 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:29.096931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d1a24fed-f57c-48d1-9429-c9ba62d894f1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.552685 Aug 31 09:49:29.103782 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:29.119846 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 71/146] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:28 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:29.121225 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e5558417-a362-41a2-88fc-21481a422eea tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1314 microversion: 2.1 time: 0.518184 Aug 31 09:49:29.127700 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 76/147] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:28 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:29.135097 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:29.136045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:29.150873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.151888 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.152614 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.153820 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.154511 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.157223 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.513523 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:29.535271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-cad7af6f-9d1f-4f32-b513-3c62f87f8b1f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.410951 Aug 31 09:49:29.536626 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 72/148] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:29 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:29.649389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:29.650856 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:29.667305 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.668863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.669933 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:29.672349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:29.672815 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:29.673998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.048702 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:30.067982 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7ae61b3f-2722-467f-9c4a-d6c02e2d8ae5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.427022 Aug 31 09:49:30.071684 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 77/149] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:29 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:30.126727 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:30.129876 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:30.141156 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=82 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:30.159822 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.162198 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:30.165503 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.165993 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:30.167008 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.170444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.172938 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.173608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.181685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.183221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.184732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.187001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.189888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.190874 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.458954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:30.475355 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4c17b0b8-bd20-485b-812a-e526e55a0658 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.357186 Aug 31 09:49:30.476588 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 73/150] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:30 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:30.564655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:30.567481 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:30.581400 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.582783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.584389 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.586425 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:30.587327 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:30.588052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:30.605518 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:30.622686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a00bfe7d-e50f-4ba6-aa6d-a3f9a94c916d tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1501 microversion: 2.1 time: 0.470164 Aug 31 09:49:30.623697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 78/151] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:30 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1501 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:30.839046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:30.849622 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-59e46d79-fd02-4bde-8feb-cfe991b53887 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.294610 Aug 31 09:49:30.850321 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 74/152] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:30 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:31.122981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:31.136444 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:31.174647 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.188850 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.193250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.196101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.199099 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.200674 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.501171 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:31.502174 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:31.521414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.522793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:31.526137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.536493 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.538063 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-121ac09a-e3b3-4a80-afe0-a2ac35d153ae tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.423175 Aug 31 09:49:31.538852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.540014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.542751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.552849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 79/153] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:31 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:31.730687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-247e112f-977f-464a-821d-e91ee39a9655 req-7e708ca6-ab98-48c7-a47b-84da78e20240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ff3858-3242-45d8-ad69-757d5b9c6d7c", "name": "network-vif-plugged", "status": "completed", "tag": "6f61b202-be56-46f9-938f-4a4424b4710e"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:31.757753 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-247e112f-977f-464a-821d-e91ee39a9655 req-7e708ca6-ab98-48c7-a47b-84da78e20240 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.758348 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-247e112f-977f-464a-821d-e91ee39a9655 req-7e708ca6-ab98-48c7-a47b-84da78e20240 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.758910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-247e112f-977f-464a-821d-e91ee39a9655 req-7e708ca6-ab98-48c7-a47b-84da78e20240 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.797508 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-247e112f-977f-464a-821d-e91ee39a9655 req-7e708ca6-ab98-48c7-a47b-84da78e20240 service nova] Creating event network-vif-plugged:6f61b202-be56-46f9-938f-4a4424b4710e for instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c on hv-cinder-83754 Aug 31 09:49:31.815879 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-247e112f-977f-464a-821d-e91ee39a9655 req-7e708ca6-ab98-48c7-a47b-84da78e20240 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084547 Aug 31 09:49:31.817410 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 80/154] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:31.881525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:31.890235 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:31.906848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:31.918019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-28fd81ae-aded-464b-bac4-f3a6bc5c6222 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.424016 Aug 31 09:49:31.919817 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 75/155] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:31 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:31.929336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.930224 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.931031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:31.932144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:31.932822 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:31.933449 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.436118 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:32.448885 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0e0bd672-ed19-487f-babd-1864786a810b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.573278 Aug 31 09:49:32.465948 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 81/156] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:31 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:32.565314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:32.569000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:32.599620 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.614225 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.616441 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.625041 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.631017 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.632302 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.792669 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-000e9bfe-7066-4810-b5b3-4225a2e83fe8 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f31a8b9-70b4-4b33-a8c8-fae30af19e74"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:32.807974 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-000e9bfe-7066-4810-b5b3-4225a2e83fe8 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:32.824160 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-000e9bfe-7066-4810-b5b3-4225a2e83fe8 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.824727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-000e9bfe-7066-4810-b5b3-4225a2e83fe8 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.825734 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-000e9bfe-7066-4810-b5b3-4225a2e83fe8 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.827457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-000e9bfe-7066-4810-b5b3-4225a2e83fe8 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:32.828488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-000e9bfe-7066-4810-b5b3-4225a2e83fe8 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:32.829204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-000e9bfe-7066-4810-b5b3-4225a2e83fe8 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:32.976889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:32.987249 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c82cadb5-a005-4779-9527-0c8516525680 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.429247 Aug 31 09:49:33.001573 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 76/157] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:32 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:33.007148 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:33.008170 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:33.031693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.032224 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.032659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.033386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.033834 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.034264 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.355962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:33.376173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f39f5fc0-7eb0-4556-90d2-96582a21ac66 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.372750 Aug 31 09:49:33.377169 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 77/158] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:33 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:33.475407 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:33.476031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:33.492150 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.493141 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.494742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:33.496943 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:33.499284 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:33.500879 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.161940 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:34.171447 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-10fb5c0c-aff0-46ec-9d2d-dac95dc320d7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.700458 Aug 31 09:49:34.175566 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 78/159] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:33 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:34.192113 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-7a270bb7-bc23-447f-82a4-573430798de5 req-a14dd910-e562-41b6-9ba4-3f591408c827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44963711-215e-4aca-bdfb-7d22be495691", "name": "network-vif-plugged", "status": "completed", "tag": "3e4253e5-5b4e-4671-ad15-d6b2b34c4cba"}, {"server_uuid": "2795070d-ec5b-480c-91d5-f1317b74ea69", "name": "network-vif-plugged", "status": "completed", "tag": "a2b8c3ca-e7e6-4da8-a26d-11ed9ce5e3dc"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:34.217640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-7a270bb7-bc23-447f-82a4-573430798de5 req-a14dd910-e562-41b6-9ba4-3f591408c827 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.231975 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-7a270bb7-bc23-447f-82a4-573430798de5 req-a14dd910-e562-41b6-9ba4-3f591408c827 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.235792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-7a270bb7-bc23-447f-82a4-573430798de5 req-a14dd910-e562-41b6-9ba4-3f591408c827 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.292762 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-7a270bb7-bc23-447f-82a4-573430798de5 req-a14dd910-e562-41b6-9ba4-3f591408c827 service nova] Creating event network-vif-plugged:3e4253e5-5b4e-4671-ad15-d6b2b34c4cba for instance 44963711-215e-4aca-bdfb-7d22be495691 on hv-cinder-83754 Aug 31 09:49:34.293241 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-7a270bb7-bc23-447f-82a4-573430798de5 req-a14dd910-e562-41b6-9ba4-3f591408c827 service nova] Creating event network-vif-plugged:a2b8c3ca-e7e6-4da8-a26d-11ed9ce5e3dc for instance 2795070d-ec5b-480c-91d5-f1317b74ea69 on hv-cinder-83754 Aug 31 09:49:34.322442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-7a270bb7-bc23-447f-82a4-573430798de5 req-a14dd910-e562-41b6-9ba4-3f591408c827 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.140371 Aug 31 09:49:34.326628 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 79/160] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:34.350383 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:34.351417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:34.374519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.380531 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.382093 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-000e9bfe-7066-4810-b5b3-4225a2e83fe8 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "POST /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.608949 Aug 31 09:49:34.382803 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 82/161] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:49:32 2022] POST /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef/os-volume_attachments => generated 194 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:34.389159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.390345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.391716 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.393952 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.405881 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:34.405881 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:34.467951 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.468457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.468903 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.481404 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:34.481961 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:34.482413 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:34.774212 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:34.783850 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-06a98dc5-d44a-4c46-b241-50b9a4f6d2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.385362 Aug 31 09:49:34.804571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 83/162] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:34 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:34.833865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:34.853011 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7a83b309-228d-4957-a240-5b4a0d4fdff0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.519320 Aug 31 09:49:34.856218 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 80/163] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:34 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:35.203998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:35.205292 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:35.214021 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.214893 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.217153 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.218488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.219333 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.220125 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.574440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:35.613850 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-784e4b85-f1cc-4b75-bb68-27807bcdeaec tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.412969 Aug 31 09:49:35.615719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 84/164] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:35 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:35.813511 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:35.815342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:35.825765 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.827815 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.828884 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.830186 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.830897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.831377 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.896574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:35.899460 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:35.928739 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.930335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.936389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:35.938446 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:35.940561 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:35.942634 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.271823 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:36.282441 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-86eaafa6-001b-463b-99e7-5471ce6b4c9a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.473521 Aug 31 09:49:36.285299 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 81/165] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:35 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:36.295955 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:36.314119 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4b14422e-e1a2-4066-901e-be7f31c25b72 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1363 microversion: 2.1 time: 0.426858 Aug 31 09:49:36.328651 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 85/166] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:35 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:36.462753 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-0beecc8f-f03e-4f6c-b166-7e240a35a2c0 req-c37d71c3-26a3-4b56-ae75-4f486aad8609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84e69de-d263-47c5-a190-3e39a8087f17", "name": "network-vif-plugged", "status": "completed", "tag": "f2a2ff95-6baf-4704-b5e9-844a4a2195ce"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:36.475031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-0beecc8f-f03e-4f6c-b166-7e240a35a2c0 req-c37d71c3-26a3-4b56-ae75-4f486aad8609 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.475570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-0beecc8f-f03e-4f6c-b166-7e240a35a2c0 req-c37d71c3-26a3-4b56-ae75-4f486aad8609 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.476006 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-0beecc8f-f03e-4f6c-b166-7e240a35a2c0 req-c37d71c3-26a3-4b56-ae75-4f486aad8609 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.490339 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-0beecc8f-f03e-4f6c-b166-7e240a35a2c0 req-c37d71c3-26a3-4b56-ae75-4f486aad8609 service nova] Creating event network-vif-plugged:f2a2ff95-6baf-4704-b5e9-844a4a2195ce for instance c84e69de-d263-47c5-a190-3e39a8087f17 on hv-cinder-83754 Aug 31 09:49:36.497297 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-0beecc8f-f03e-4f6c-b166-7e240a35a2c0 req-c37d71c3-26a3-4b56-ae75-4f486aad8609 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038615 Aug 31 09:49:36.498713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 82/167] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:49:36.655849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:36.655849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:36.665318 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.667556 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.668229 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.669123 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:36.670641 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:36.671077 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:36.902523 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:36.921710 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f844eb7f-4ad6-4871-9d42-d614bd028021 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1321 microversion: 2.1 time: 0.270283 Aug 31 09:49:36.923638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 86/168] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:36 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:37.308722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:37.309435 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:37.323457 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.324166 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.324501 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.325236 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.325693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.326108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.358974 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:37.360420 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:37.385617 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.385617 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.385617 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.385617 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.386252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.386252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.672318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:37.695947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0b8bec5b-b6ae-41f0-b560-487a7ffd2fb0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.393316 Aug 31 09:49:37.697262 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 83/169] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:37 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:37.752178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:37.787930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6ed6ea41-03ba-44c9-bb80-a3e0f64052d0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1547 microversion: 2.1 time: 0.434278 Aug 31 09:49:37.792073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 87/170] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:37 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1547 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:37.831040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ef43a416-229b-4e50-af18-fe89788e8ffd tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:37.832847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ef43a416-229b-4e50-af18-fe89788e8ffd tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:37.844688 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef43a416-229b-4e50-af18-fe89788e8ffd tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.846325 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef43a416-229b-4e50-af18-fe89788e8ffd tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.847917 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef43a416-229b-4e50-af18-fe89788e8ffd tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.850099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef43a416-229b-4e50-af18-fe89788e8ffd tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.851448 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef43a416-229b-4e50-af18-fe89788e8ffd tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.852577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef43a416-229b-4e50-af18-fe89788e8ffd tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.945502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:37.946524 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:37.966425 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.969633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.970358 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:37.973621 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:37.974357 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:37.975151 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.189831 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ef43a416-229b-4e50-af18-fe89788e8ffd tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.365247 Aug 31 09:49:38.190914 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 84/171] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 09:49:37 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/os-interface => generated 284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:49:38.317096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:38.331592 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-188985e7-3519-43d4-a509-65d488178d65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1514 microversion: 2.1 time: 0.390540 Aug 31 09:49:38.332825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 88/172] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:37 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1514 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:38.384374 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:38.391345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:38.422627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.425091 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.430380 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.430655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.435482 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.436632 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.458479 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=100 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:38.512140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lazy-loading 'flavor' on Instance uuid 44963711-215e-4aca-bdfb-7d22be495691 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:38.702757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ffb4c9f2-e5cc-4908-9531-aec0e200bf70 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691/action" status: 200 len: 32 microversion: 2.1 time: 0.322234 Aug 31 09:49:38.705513 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 85/173] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:49:38 2022] POST /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691/action => generated 32 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:49:38.720008 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:38.722794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:38.743282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:38.745807 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:38.762843 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.763625 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.765831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.769105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.770293 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.771494 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.772467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.773606 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.774836 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:38.776843 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:38.778160 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:38.779635 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:39.195071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:39.212309 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c9006929-71a2-46c7-af64-f6fd8bcc7482 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.499492 Aug 31 09:49:39.227557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 89/174] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:38 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:39.537677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:39.550941 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6aeae5a5-3ab4-4ae6-8b23-092b5f1dc15f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.822503 Aug 31 09:49:39.564139 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 86/175] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:38 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:40.251576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:40.254703 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:40.266725 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.267547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.268492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.269979 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.270990 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.271987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.555488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:40.569708 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-07cd1bb5-6da2-40f0-bb51-203727e3c000 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.324686 Aug 31 09:49:40.588686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 90/176] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:40 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:40.595553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:40.596884 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:40.613293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.614259 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.620999 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.622025 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:40.622499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:40.622929 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:40.974678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:40.988307 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b0100620-5ae7-4f13-80c9-649813168702 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1367 microversion: 2.1 time: 0.400329 Aug 31 09:49:41.003677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 87/177] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:40 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:41.600017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:41.601429 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:41.613284 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:41.621193 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-aa0f9a17-ea9f-447f-bb14-5ae7af176726 req-65a74d15-642a-4f94-bf18-9ae713883de1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2795070d-ec5b-480c-91d5-f1317b74ea69", "tag": "a2b8c3ca-e7e6-4da8-a26d-11ed9ce5e3dc"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:41.630361 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:41.631099 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.634531 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:41.635990 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:41.637320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.649078 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-aa0f9a17-ea9f-447f-bb14-5ae7af176726 req-65a74d15-642a-4f94-bf18-9ae713883de1 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:41.651449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-aa0f9a17-ea9f-447f-bb14-5ae7af176726 req-65a74d15-642a-4f94-bf18-9ae713883de1 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:41.653239 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-aa0f9a17-ea9f-447f-bb14-5ae7af176726 req-65a74d15-642a-4f94-bf18-9ae713883de1 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:41.686064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-aa0f9a17-ea9f-447f-bb14-5ae7af176726 req-65a74d15-642a-4f94-bf18-9ae713883de1 service nova] Creating event network-changed:a2b8c3ca-e7e6-4da8-a26d-11ed9ce5e3dc for instance 2795070d-ec5b-480c-91d5-f1317b74ea69 on hv-cinder-83754 Aug 31 09:49:41.701456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-aa0f9a17-ea9f-447f-bb14-5ae7af176726 req-65a74d15-642a-4f94-bf18-9ae713883de1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085265 Aug 31 09:49:41.702443 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 88/178] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:42.017500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:42.018594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:42.034143 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.036744 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.039720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.040936 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.044499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.049708 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.100978 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:42.106632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:42.123087 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-49e34978-1984-4b18-bcd5-09a425628936 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.526712 Aug 31 09:49:42.124494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 91/179] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:41 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:42.604245 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:42.615093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-17d6f534-2ff0-4260-8caf-cdee0daa7674 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1557 microversion: 2.1 time: 0.602375 Aug 31 09:49:42.616695 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 89/180] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:42 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1557 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:42.647576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-35b1c97f-223b-44b0-baee-14188a294550 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:42.648888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-35b1c97f-223b-44b0-baee-14188a294550 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:42.659461 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-35b1c97f-223b-44b0-baee-14188a294550 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.660911 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-35b1c97f-223b-44b0-baee-14188a294550 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.661725 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-35b1c97f-223b-44b0-baee-14188a294550 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.662826 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-35b1c97f-223b-44b0-baee-14188a294550 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:42.663488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-35b1c97f-223b-44b0-baee-14188a294550 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:42.664060 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-35b1c97f-223b-44b0-baee-14188a294550 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:42.781868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-35b1c97f-223b-44b0-baee-14188a294550 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138988 Aug 31 09:49:42.782483 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 92/181] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 09:49:42 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:49:43.155641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:43.156304 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:43.164801 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.165413 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.165905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.166601 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:43.167393 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:43.168234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:43.539516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:43.591369 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5088982b-d872-4451-a7ae-97c79d78e802 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.443583 Aug 31 09:49:43.592435 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 90/182] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:43 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:44.622207 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:44.622831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:44.637213 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:44.637739 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:44.638178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:44.641678 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:44.642216 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:44.644561 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:45.068204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:45.086124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-14173928-81c3-4e0d-b73c-8280b06e1602 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.467889 Aug 31 09:49:45.104032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 93/183] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:44 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:45.416115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-c8a125a5-dac7-4f12-b1f8-9586e0e50570 req-4cfc4a0a-1f96-4611-a374-9031dd95a1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c84e69de-d263-47c5-a190-3e39a8087f17", "tag": "f2a2ff95-6baf-4704-b5e9-844a4a2195ce"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:45.438749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-c8a125a5-dac7-4f12-b1f8-9586e0e50570 req-4cfc4a0a-1f96-4611-a374-9031dd95a1b2 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:45.442238 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-c8a125a5-dac7-4f12-b1f8-9586e0e50570 req-4cfc4a0a-1f96-4611-a374-9031dd95a1b2 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:45.443350 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-c8a125a5-dac7-4f12-b1f8-9586e0e50570 req-4cfc4a0a-1f96-4611-a374-9031dd95a1b2 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:45.474315 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-c8a125a5-dac7-4f12-b1f8-9586e0e50570 req-4cfc4a0a-1f96-4611-a374-9031dd95a1b2 service nova] Creating event network-changed:f2a2ff95-6baf-4704-b5e9-844a4a2195ce for instance c84e69de-d263-47c5-a190-3e39a8087f17 on hv-cinder-83754 Aug 31 09:49:45.487024 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-c8a125a5-dac7-4f12-b1f8-9586e0e50570 req-4cfc4a0a-1f96-4611-a374-9031dd95a1b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077441 Aug 31 09:49:45.488711 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 91/184] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:46.145073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:46.145885 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:46.169012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.169642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.170105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.170998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.171616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.178289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.509489 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:46.542001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b84340c3-ac9b-448c-976b-c3afe3a53b38 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.409015 Aug 31 09:49:46.543214 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 94/185] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:46 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:46.675653 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:46.677189 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:46.688320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.689109 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.689770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.693751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.694458 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.695041 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.725699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Going to try to terminate instance {{(pid=132571) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:49:46.917250 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0daf984e-6dec-444e-8a13-de731cd6e41a tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "DELETE /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 204 len: 0 microversion: 2.1 time: 0.247044 Aug 31 09:49:46.918369 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 92/186] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:49:46 2022] DELETE /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:49:46.928639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:46.929538 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:46.936909 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.937492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.938090 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:46.938814 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:46.939602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:46.940043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.503208 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:47.522643 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6cada393-a022-4e5c-a45d-3a52e151711b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1553 microversion: 2.1 time: 0.594358 Aug 31 09:49:47.531403 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 95/187] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:46 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1553 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:47.612336 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:47.627177 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:47.647441 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.648560 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.649590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.651407 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:47.652382 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:47.653293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:47.898708 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:47.908853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-41f47a9c-7e56-4162-96cc-e53968333fac tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.320681 Aug 31 09:49:47.910010 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 93/188] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:47 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:48.551018 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:48.551642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:48.561859 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.562363 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.562798 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.563603 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.563979 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.564403 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.731712 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:48.750904 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ae1ba21b-0950-440c-876b-8d73090135cc tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1553 microversion: 2.1 time: 0.203846 Aug 31 09:49:48.754400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 96/189] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:48 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:48.934401 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:48.935191 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:48.944144 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.944641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.945140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:48.946226 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:48.947334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:48.948257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:49.192000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:49.210605 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-20cf7109-7721-42fa-9d6f-35371cb9d6a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.281532 Aug 31 09:49:49.214523 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 94/190] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:48 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:49.794662 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:49.795769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:49.812265 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:49.812867 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:49.813517 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:49.814470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:49.815318 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:49.816752 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.078107 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:50.092251 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ec7a4a35-d782-4f02-b98c-46988f4d82a4 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1553 microversion: 2.1 time: 0.305070 Aug 31 09:49:50.092853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 97/191] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:49 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:50.217678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-d7821964-902d-45f7-96c2-f6c3cd3f8d2b req-6a4df0ad-621d-4213-89cc-f24663e3c0a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78c94c0f-080d-4a60-8eb9-55ec8270ffef", "name": "network-vif-deleted", "tag": "3bf52432-0f69-4762-9ab5-38cfb050a75d"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:49:50.228453 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d7821964-902d-45f7-96c2-f6c3cd3f8d2b req-6a4df0ad-621d-4213-89cc-f24663e3c0a6 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.230965 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d7821964-902d-45f7-96c2-f6c3cd3f8d2b req-6a4df0ad-621d-4213-89cc-f24663e3c0a6 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.230965 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d7821964-902d-45f7-96c2-f6c3cd3f8d2b req-6a4df0ad-621d-4213-89cc-f24663e3c0a6 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.238742 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:50.239698 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:50.250318 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.251113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.251743 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.252872 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:50.254514 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:50.255144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:50.294782 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-d7821964-902d-45f7-96c2-f6c3cd3f8d2b req-6a4df0ad-621d-4213-89cc-f24663e3c0a6 service nova] Creating event network-vif-deleted:3bf52432-0f69-4762-9ab5-38cfb050a75d for instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef on hv-cinder-83754 Aug 31 09:49:50.314393 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-d7821964-902d-45f7-96c2-f6c3cd3f8d2b req-6a4df0ad-621d-4213-89cc-f24663e3c0a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100176 Aug 31 09:49:50.315865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 95/192] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:49:50.486609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:50.497797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-495b050f-6481-450e-b2fc-64caceab37f9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.263839 Aug 31 09:49:50.498545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 98/193] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:50 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:51.115470 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:51.116115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:51.123081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.123834 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.124275 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.124980 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.125683 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.126263 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.169884 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.170651 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.171095 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.171749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lazy-loading 'fault' on Instance uuid 78c94c0f-080d-4a60-8eb9-55ec8270ffef {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:49:51.238243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3df25e740c4c7f8a311d5a1574c3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f25e83fff24a8e924bb22e6f9fdd46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:51.249320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-32c7649f-c28b-4faa-8365-2e286656fe89 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 200 len: 1350 microversion: 2.1 time: 0.139009 Aug 31 09:49:51.249922 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 96/194] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:51 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:49:51.520920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:51.521573 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:51.529789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.530694 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.531393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.532508 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:51.533245 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:51.534338 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:51.710430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:51.723863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-330149fa-a6c4-408c-b9cd-12d5166139e0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.202968 Aug 31 09:49:51.725516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 99/195] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:51 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:52.277737 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:52.278458 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:52.286900 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.287706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.288411 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.289548 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.290988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.291709 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.313347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] HTTP exception thrown: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Request method failure captured: Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef HTTP/1.1 Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy51gvMF7Zx6cjrmNP_l8FqWfuuMwqdqnr15wz8wsyOBf5Fd2ZcSwe1fRAb3heDvGT4n93LqlIwBJwjVh6rJaMVf_0mDrfBKBTY0lWt9BL3Ynnq64YNuarcPfO5-_B7eUORPM6jioLS0EOhomRxEUSyNsCCR6A2pubUroblOThRIGO8 Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 09f25e83fff24a8e924bb22e6f9fdd46 Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:49:52.326205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 09f25e83fff24a8e924bb22e6f9fdd46 Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-DeleteServersTestJSON-509879147-project Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 8a3df25e740c4c7f8a311d5a1574c3ba Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-DeleteServersTestJSON-509879147-project Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.327430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '78c94c0f-080d-4a60-8eb9-55ec8270ffef'} Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:52.328167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.333123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.335644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Returning 404 to user: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:52.335644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-93a8bacb-80e5-45d2-95a2-5e7f12c4a83b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 404 len: 111 microversion: 2.1 time: 0.054767 Aug 31 09:49:52.335644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 97/196] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:52 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:52.454145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:52.457192 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:52.464201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.464972 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.465572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.466290 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.467059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.467509 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.482247 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] HTTP exception thrown: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Request method failure captured: Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef/os-volume_attachments HTTP/1.1 Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy51gvMF7Zx6cjrmNP_l8FqWfuuMwqdqnr15wz8wsyOBf5Fd2ZcSwe1fRAb3heDvGT4n93LqlIwBJwjVh6rJaMVf_0mDrfBKBTY0lWt9BL3Ynnq64YNuarcPfO5-_B7eUORPM6jioLS0EOhomRxEUSyNsCCR6A2pubUroblOThRIGO8 Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 09f25e83fff24a8e924bb22e6f9fdd46 Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:49:52.487011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 09f25e83fff24a8e924bb22e6f9fdd46 Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-DeleteServersTestJSON-509879147-project Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 8a3df25e740c4c7f8a311d5a1574c3ba Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-DeleteServersTestJSON-509879147-project Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.488507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'server_id': '78c94c0f-080d-4a60-8eb9-55ec8270ffef'} Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:52.489301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:52.490557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:52.491762 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Returning 404 to user: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:52.491762 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0e93be7c-928f-4615-8868-86582e0d133b tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038889 Aug 31 09:49:52.491762 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 100/197] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:49:52 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:52.748521 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:52.749470 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:52.757126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.757638 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.758062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.758807 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:52.759303 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:52.759730 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:52.936099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:52.953002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-279ba0dd-dfb2-4e48-a53b-d72c6ff8244e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.207887 Aug 31 09:49:52.955431 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 98/198] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:52 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:53.979404 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:53.980012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:53.987339 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:53.987554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:53.988037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:53.988770 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:53.989201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:53.989634 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.184750 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:54.194297 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c1fa0133-219b-47bf-9530-6d510b33aa3c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.218899 Aug 31 09:49:54.195678 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 101/199] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:53 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:54.403928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:54.404639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:54.416275 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.417063 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.417872 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.419292 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.420247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.420709 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.442508 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] HTTP exception thrown: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Request method failure captured: Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: DELETE /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef HTTP/1.1 Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy51gvMF7Zx6cjrmNP_l8FqWfuuMwqdqnr15wz8wsyOBf5Fd2ZcSwe1fRAb3heDvGT4n93LqlIwBJwjVh6rJaMVf_0mDrfBKBTY0lWt9BL3Ynnq64YNuarcPfO5-_B7eUORPM6jioLS0EOhomRxEUSyNsCCR6A2pubUroblOThRIGO8 Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 09f25e83fff24a8e924bb22e6f9fdd46 Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:49:54.444187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 09f25e83fff24a8e924bb22e6f9fdd46 Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-DeleteServersTestJSON-509879147-project Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 8a3df25e740c4c7f8a311d5a1574c3ba Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-DeleteServersTestJSON-509879147-project Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.445314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '78c94c0f-080d-4a60-8eb9-55ec8270ffef'} Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:54.445986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.448000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.449141 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Returning 404 to user: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:54.449141 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8410c5d4-459d-4f29-b8c2-503edd62285f tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "DELETE /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 404 len: 111 microversion: 2.1 time: 0.047403 Aug 31 09:49:54.455972 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:54.457540 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] [instance: 78c94c0f-080d-4a60-8eb9-55ec8270ffef] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:54.460664 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 99/200] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:49:54 2022] DELETE /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:54.465663 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.466454 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.467178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.468397 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:54.469223 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:54.469817 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:54.501253 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] HTTP exception thrown: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Request method failure captured: Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef HTTP/1.1 Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy51gvMF7Zx6cjrmNP_l8FqWfuuMwqdqnr15wz8wsyOBf5Fd2ZcSwe1fRAb3heDvGT4n93LqlIwBJwjVh6rJaMVf_0mDrfBKBTY0lWt9BL3Ynnq64YNuarcPfO5-_B7eUORPM6jioLS0EOhomRxEUSyNsCCR6A2pubUroblOThRIGO8 Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 09f25e83fff24a8e924bb22e6f9fdd46 Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:49:54.504335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/09f25e83fff24a8e924bb22e6f9fdd46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 09f25e83fff24a8e924bb22e6f9fdd46 Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-DeleteServersTestJSON-509879147 Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-DeleteServersTestJSON-509879147-project Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 8a3df25e740c4c7f8a311d5a1574c3ba Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-DeleteServersTestJSON-509879147-project Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.506788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': '78c94c0f-080d-4a60-8eb9-55ec8270ffef'} Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:49:54.508227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. Aug 31 09:49:54.510560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:49:54.512690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] Returning 404 to user: Instance 78c94c0f-080d-4a60-8eb9-55ec8270ffef could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:49:54.512690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f5245c0f-a9cf-42e1-b037-0afe63ee6bf6 tempest-DeleteServersTestJSON-509879147 tempest-DeleteServersTestJSON-509879147-project] 10.222.0.36 "GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef" status: 404 len: 111 microversion: 2.1 time: 0.054366 Aug 31 09:49:54.512690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 102/201] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:54 2022] GET /compute/v2.1/servers/78c94c0f-080d-4a60-8eb9-55ec8270ffef => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:55.225928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:55.230037 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:55.312399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:55.313993 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:55.316379 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:55.317505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:55.318529 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:55.319414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:55.599625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:55.616862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7b8ac3f3-1573-431c-a2e2-665ba597bc21 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.401200 Aug 31 09:49:55.622018 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 100/202] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:55 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:56.659452 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:56.660617 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:56.677325 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:56.679895 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:56.680890 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:56.682676 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:56.684959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:56.686322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:56.883851 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:56.895051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e72b3909-919f-4d07-98ff-cfa5f472c75e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.239297 Aug 31 09:49:56.896353 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 103/203] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:56 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:57.917702 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:57.919386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:57.929083 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.929912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.930713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.931702 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:57.932440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:57.933084 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:57.938269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:58.188874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:58.198968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-16f4ca68-c16b-493d-9048-8ff63a013b8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.285127 Aug 31 09:49:58.199908 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 101/204] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:57 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:49:59.223667 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:49:59.225058 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:49:59.227968 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=56 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:59.234949 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.235968 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.236583 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.237543 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:49:59.238321 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:49:59.238916 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:49:59.508462 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:49:59.524321 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-949c3a4f-58a6-4992-863b-829c6bdc2889 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.306314 Aug 31 09:49:59.525591 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 104/205] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:49:59 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:00.556191 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:00.556860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:00.558943 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:00.564529 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:00.565028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:00.566045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:00.567386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:00.568164 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:00.568767 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:00.779538 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:00.788562 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0aeb40ac-0e5e-41bc-ad32-1887ec72c200 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.236098 Aug 31 09:50:00.789379 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 102/206] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:00 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:01.812870 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:01.813583 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:01.823556 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.826371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.827300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:01.828308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:01.829302 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:01.830209 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:02.239417 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:02.255480 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8b1a9c75-1076-415d-bc30-93e385b3c54f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.446393 Aug 31 09:50:02.256412 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 105/207] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:01 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:03.296217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:03.296830 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:03.306420 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.308581 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.309052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.309815 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:03.310289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:03.310713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:03.683591 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:03.698323 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-98c2f018-b043-493c-ad15-c114c5588903 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.405357 Aug 31 09:50:03.699667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 103/208] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:03 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:04.733268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:04.734808 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:04.751848 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.753007 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.754291 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:04.757369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:04.758767 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:04.759644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:05.254309 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:05.267113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4f0c9d7c-bafe-4804-93b4-18479e7a31a7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.541988 Aug 31 09:50:05.273729 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 106/209] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:04 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:06.303372 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:06.304835 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:06.312577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:06.313386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:06.314051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:06.315114 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:06.315833 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:06.316698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:06.630188 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:06.642711 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4c03ce42-682b-46ac-b74d-0423b1ace326 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.348809 Aug 31 09:50:06.644436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 104/210] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:06 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:07.666664 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:07.668178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:07.677100 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:07.677905 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:07.679757 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:07.680953 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:07.681635 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:07.682235 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:07.885246 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:07.894960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-51c94399-0cec-4dd9-af1d-2d68c88e8dc2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.233323 Aug 31 09:50:07.900342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 107/211] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:07 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:08.712090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-00aaa242-2b34-4875-b37b-6da9eeb96932 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'create', calling method: .version_select at 0x7f94639d7940>, body: {"keypair": {"name": "tempest-keypair-1368849715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYc6DBYmpgGuX7FmuNMVCNHdsNhco5tnfDbXTKPhbIe1CqIfd4YSvZTMa/sbd87mbCHxYIgNmrAraKQ1Ucvhsl+XLJFPQr61YaRaqHS+KhJ1fu7FeY5zdje+z2n9HtN9A=="}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:08.729806 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-00aaa242-2b34-4875-b37b-6da9eeb96932 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Getting quotas for project 40a8edca05bf4490948bb10b390bb373. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:50:08.734397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-00aaa242-2b34-4875-b37b-6da9eeb96932 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Getting quotas for user 18eecdfed8cc44f685095b6a70a4e69d and project 40a8edca05bf4490948bb10b390bb373. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:50:08.765521 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-00aaa242-2b34-4875-b37b-6da9eeb96932 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.205138 Aug 31 09:50:08.766142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 105/212] 10.222.0.36 () {62 vars in 1200 bytes} [Wed Aug 31 09:50:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 09:50:08.916634 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:08.917286 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:08.926567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:08.927065 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.938347 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:08.939293 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:08.939771 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:08.941011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:09.310083 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:09.326719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dc44fd5d-8df8-4f2d-80c7-8f64b4f02ef0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.413997 Aug 31 09:50:09.327494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 108/213] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:08 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:10.360847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:10.361529 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:10.368661 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.369244 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.369758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.370546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:10.371014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:10.375037 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:10.554589 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:10.567104 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-69fcbca9-3cc5-4037-841e-bc8e3f3208f3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.206697 Aug 31 09:50:10.567860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 106/214] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:10 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:10.588233 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-220695284", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4ce22a7-9418-45fc-a1e0-ce7146d1a645"}], "security_groups": [{"name": "tempest-securitygroup--1367332456"}], "key_name": "tempest-keypair-1368849715", "user_data": "}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:11.590023 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:11.590778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:11.597822 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:11.598397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:11.598914 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:11.599749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:11.600457 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:11.601028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:11.825342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:11.835326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-158791f4-c8f7-4834-982f-e467929605bf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.249344 Aug 31 09:50:11.835926 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 107/215] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:11 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:12.860993 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:12.861734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:12.870886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:12.871428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:12.871859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:12.872556 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:12.873002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:12.873419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:13.047991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:13.058758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8f2db109-54da-4e1a-b8a5-c365191c9cf9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.201751 Aug 31 09:50:13.059551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 108/216] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:12 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:14.082808 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:14.083633 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:14.091466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.091962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.092431 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.093166 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:14.093612 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:14.094028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:14.243367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:14.251149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ba37bad7-3dc7-4339-9f9a-ff6d852d618d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.172537 Aug 31 09:50:14.251854 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 109/217] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:14 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:15.274409 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:15.275080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:15.281185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:15.281959 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:15.282397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:15.283179 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:15.284191 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:15.284877 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:15.466396 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:15.475474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0c7997fc-e629-4abd-a7d8-bb18a776cca5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.205157 Aug 31 09:50:15.476132 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 110/218] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:15 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:15.740053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.network.neutron [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] validate_networks() for [('b4ce22a7-9418-45fc-a1e0-ce7146d1a645', None, None, None, None, None)] {{(pid=132570) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:50:16.189443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Flavor limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:50:16.189879 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Image limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:50:16.190343 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Flavor pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:50:16.190906 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Image pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:50:16.191347 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:50:16.201516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.201996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.202485 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.203262 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.203713 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.204135 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.212252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=93 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:16.234819 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Getting quotas for project 40a8edca05bf4490948bb10b390bb373. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:50:16.240269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Getting quotas for user 18eecdfed8cc44f685095b6a70a4e69d and project 40a8edca05bf4490948bb10b390bb373. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:50:16.254391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Going to run 1 instances... {{(pid=132570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:50:16.256902 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:50:16.321592 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-502078c7-b8eb-4fdc-8976-d82016514e26 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.747189 Aug 31 09:50:16.331430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 109/219] 10.222.0.36 () {62 vars in 1188 bytes} [Wed Aug 31 09:50:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 5759 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 09:50:16.340322 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8f6fe08a-a0c5-4021-96f3-fd1dcd1b2453 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:16.341560 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8f6fe08a-a0c5-4021-96f3-fd1dcd1b2453 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:16.448923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8f6fe08a-a0c5-4021-96f3-fd1dcd1b2453 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.459624 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8f6fe08a-a0c5-4021-96f3-fd1dcd1b2453 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.461650 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8f6fe08a-a0c5-4021-96f3-fd1dcd1b2453 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.463618 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8f6fe08a-a0c5-4021-96f3-fd1dcd1b2453 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1281 microversion: 2.20 time: 0.128428 Aug 31 09:50:16.464349 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 111/220] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:16 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1281 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:16.510857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:16.512445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:16.525274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.525938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.526378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.527111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:16.527650 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:16.528109 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:16.733659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:16.750008 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b407193f-c14c-4631-bad2-4fa8682a9194 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.244120 Aug 31 09:50:16.753988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 110/221] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:16 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:17.487460 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:17.488472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:17.497655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.498438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.499395 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.500850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.501621 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.503918 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.612772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.624813 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.626555 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.629966 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b5f28477-4daa-4451-9252-6706daa1e184 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1285 microversion: 2.20 time: 0.146989 Aug 31 09:50:17.630721 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 112/222] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:17 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:17.786633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:17.787532 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:17.798130 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.798806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.799589 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.800639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:17.801219 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:17.801849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:17.976742 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:17.990266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2ddb730c-fa50-4083-ac46-ed7a0f8d65da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.207770 Aug 31 09:50:17.991221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 111/223] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:17 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:18.658031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:18.658712 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:18.665285 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.665760 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.666185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.666884 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:18.667357 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:18.667771 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:18.733866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:18.745862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:18.748207 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:18.750106 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c1287851-ddcd-4352-a709-2e4fee2215f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1285 microversion: 2.20 time: 0.095897 Aug 31 09:50:18.751816 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 113/224] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:18 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:19.015403 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:19.016308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:19.025241 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.025722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.026150 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.026851 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.027337 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.027755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.173108 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:19.181488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-614e8063-95e7-4428-8878-1193186ffa51 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.170750 Aug 31 09:50:19.182071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 112/225] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:19 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:19.782206 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:19.782815 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:19.789832 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.790318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.790768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.791578 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:19.791912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:19.792330 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:19.871016 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:19.879658 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:19.881101 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:19.882244 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a122b136-18b5-4d2f-92e9-9402ea7e35fd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1333 microversion: 2.20 time: 0.104166 Aug 31 09:50:19.882890 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 114/226] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:19 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:20.202995 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:20.203640 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:20.210627 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:20.211112 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:20.211578 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:20.212268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:20.212722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:20.213153 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:20.357295 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:20.366789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-651659ac-49f9-4c11-9122-4ed476092332 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1520 microversion: 2.1 time: 0.167584 Aug 31 09:50:20.367430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 113/227] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:20 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:20.419569 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-74587644", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:20.473351 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] validate_networks() for None {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:50:20.806179 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:50:20.806814 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:50:20.807436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:50:20.808023 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:50:20.808439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:50:20.817992 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:20.818475 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:20.818905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:20.819658 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:20.820108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:20.820529 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:20.837657 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Getting quotas for project c88af70f29db4015a6fce06089debe5c. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:50:20.841608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Getting quotas for user 646da13f9db94b0fa2302d6b45774e54 and project c88af70f29db4015a6fce06089debe5c. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:50:20.854060 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:50:20.856393 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:50:20.906842 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:20.907783 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:20.914336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:20.915056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:20.915745 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:20.916598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:20.917043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:20.917463 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:20.920350 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4d4557fb-3633-485f-88bd-0a69573ff46e tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.504461 Aug 31 09:50:20.928522 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 115/228] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:50:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:50:20.933435 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3c6da658-2924-4ccc-b75b-aac04052566c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:20.934046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3c6da658-2924-4ccc-b75b-aac04052566c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:20.995487 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3c6da658-2924-4ccc-b75b-aac04052566c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.007444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3c6da658-2924-4ccc-b75b-aac04052566c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1213 microversion: 2.1 time: 0.077715 Aug 31 09:50:21.011486 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 116/229] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:20 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:21.011790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.022382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.024077 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.025301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fe16e614-b24f-4d02-95b7-f3a03ddfc2d6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1333 microversion: 2.20 time: 0.122764 Aug 31 09:50:21.025945 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 114/230] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:20 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1333 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:21.388660 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:21.389488 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:21.399749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.400309 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.400685 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.401401 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.402130 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.402562 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.792680 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:21.802160 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-88d515f2-2df3-4b62-b260-900e92312f95 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1500 microversion: 2.1 time: 0.417760 Aug 31 09:50:21.802998 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 117/231] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:21 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1500 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:21.824753 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:21.825365 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:21.833104 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.833619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.834051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:21.835017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:21.835597 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:21.836137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.002420 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:22.011618 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-bc1b0280-f629-4948-ac3c-019db7c79bd9 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1515 microversion: 2.1 time: 0.191332 Aug 31 09:50:22.012286 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 115/232] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:21 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:22.028817 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:22.031142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:22.039927 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.040569 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.041314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.042228 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.042867 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.043505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.049772 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:22.050574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:22.059293 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.060832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.063480 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.064554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:22.065624 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:22.070653 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:22.176554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:22.185010 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:22.186726 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:22.188058 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-62b8886d-081d-4212-b577-dfcdcf3cf7e4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1339 microversion: 2.20 time: 0.143955 Aug 31 09:50:22.189079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 116/233] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:22 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:22.200917 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:22.214075 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-de572f58-a588-488f-bdde-44098be38397 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1209 microversion: 2.1 time: 0.190607 Aug 31 09:50:22.224702 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 118/234] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:22 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1209 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:23.212318 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:23.212844 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:23.238774 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:23.239384 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:23.244187 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.244673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.245268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.246117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.246714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.246846 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.247447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.247562 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.248254 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.249295 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.250678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.252178 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.382143 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:23.391850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e07e7822-66b2-4834-ad21-27c4df1a90a8 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1283 microversion: 2.1 time: 0.157455 Aug 31 09:50:23.404454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 119/235] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:23 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1283 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:23.542062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:23.545010 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:23.554258 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.555102 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.555770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.556812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.557562 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.558289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.589075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:23.607215 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lazy-loading 'flavor' on Instance uuid 52ff3858-3242-45d8-ad69-757d5b9c6d7c {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:50:23.610367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:23.612961 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:23.614573 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-48cf5543-b42d-4c06-8b35-235c434ffac0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.406267 Aug 31 09:50:23.615812 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 117/236] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:23 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:23.660582 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=100 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:23.757077 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e7373bb9-d91d-42b2-aede-dbc8731bb393 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c/action" status: 200 len: 32 microversion: 2.1 time: 0.218659 Aug 31 09:50:23.758600 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 120/237] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:50:23 2022] POST /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 09:50:23.769719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:23.770466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:23.776995 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.777479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.777911 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:23.779194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:23.779709 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:23.780417 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.019682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.019682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c182adbf-d1ce-43a4-ac99-d1d839ba3207 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.255267 Aug 31 09:50:24.020753 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 118/238] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:23 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:24.283746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-7d2ec210-e92a-4b71-99ab-efd8748d2805 req-058728c8-144a-4468-9b80-5390e0d325fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2236114-93d1-4533-8199-e77b5996f54d", "tag": "3d1efd6d-0e8a-4b38-8680-3725504f96c6"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:24.296120 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-7d2ec210-e92a-4b71-99ab-efd8748d2805 req-058728c8-144a-4468-9b80-5390e0d325fc service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.296870 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-7d2ec210-e92a-4b71-99ab-efd8748d2805 req-058728c8-144a-4468-9b80-5390e0d325fc service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.297296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-7d2ec210-e92a-4b71-99ab-efd8748d2805 req-058728c8-144a-4468-9b80-5390e0d325fc service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.309139 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-7d2ec210-e92a-4b71-99ab-efd8748d2805 req-058728c8-144a-4468-9b80-5390e0d325fc service nova] Creating event network-changed:3d1efd6d-0e8a-4b38-8680-3725504f96c6 for instance e2236114-93d1-4533-8199-e77b5996f54d on hv-cinder-83754 Aug 31 09:50:24.314110 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-7d2ec210-e92a-4b71-99ab-efd8748d2805 req-058728c8-144a-4468-9b80-5390e0d325fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036604 Aug 31 09:50:24.315572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 121/239] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:50:24.417189 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:24.417970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:24.428359 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.429014 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.429571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.430417 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.431168 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.431686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.528250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.541572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f1f0cd7d-5aa5-4150-80b5-525778193c95 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1271 microversion: 2.1 time: 0.130196 Aug 31 09:50:24.542302 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 119/240] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:24 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:24.643990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:24.652778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:24.665055 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.666534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.668583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.670270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:24.671426 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:24.671866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:24.946244 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.948564 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.950156 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:24.951506 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-980077ad-dca5-4f54-b645-7f80ec498e25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.314793 Aug 31 09:50:24.963814 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 122/241] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:24 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:25.050838 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:25.051529 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:25.064980 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.067993 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.068733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.069822 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.070642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.071785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.466186 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:25.479140 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-bf068dc7-795c-4ca4-adea-562570e582ea tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.432973 Aug 31 09:50:25.481682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 120/242] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:25 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:25.568566 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:25.569798 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:25.578509 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.579289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.579877 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.582046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.582540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.582999 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.776615 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:25.795512 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9f8a3f4e-5e2d-42d3-9298-a5f112874f59 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.229579 Aug 31 09:50:25.795512 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 123/243] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:25 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:25.875066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-97abb40c-8f71-4df9-a79c-5380927639ab req-05990f71-33e9-4fbc-ae36-37aa45f1d278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496af8f8-598e-4587-9b1f-6872ae150b60", "tag": "185bbce6-b13a-4073-98c3-a7f54eb93f1e"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:25.887157 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-97abb40c-8f71-4df9-a79c-5380927639ab req-05990f71-33e9-4fbc-ae36-37aa45f1d278 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.887665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-97abb40c-8f71-4df9-a79c-5380927639ab req-05990f71-33e9-4fbc-ae36-37aa45f1d278 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.888315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-97abb40c-8f71-4df9-a79c-5380927639ab req-05990f71-33e9-4fbc-ae36-37aa45f1d278 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.900905 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-97abb40c-8f71-4df9-a79c-5380927639ab req-05990f71-33e9-4fbc-ae36-37aa45f1d278 service nova] Creating event network-changed:185bbce6-b13a-4073-98c3-a7f54eb93f1e for instance 496af8f8-598e-4587-9b1f-6872ae150b60 on hv-cinder-83754 Aug 31 09:50:25.906525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-97abb40c-8f71-4df9-a79c-5380927639ab req-05990f71-33e9-4fbc-ae36-37aa45f1d278 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035291 Aug 31 09:50:25.907203 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 121/244] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:50:25.975680 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:25.976287 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:25.982452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.982934 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.983390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:25.984085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:25.984532 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:25.984945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:26.137489 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:26.146589 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:26.148083 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:26.149224 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-088a7895-8666-4c99-b2ad-55b25873ade0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.177803 Aug 31 09:50:26.149782 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 124/245] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:25 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:26.502378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:26.503215 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=6 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:26.509975 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:26.510691 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:26.518343 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:26.518843 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:26.519930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:26.521129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:26.521600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:26.522087 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:26.697463 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:26.705160 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-13c95dd3-a4f4-4cd0-973c-8a43b8c20551 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.203943 Aug 31 09:50:26.705739 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 122/246] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:26 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:26.818991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:26.819794 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:26.829659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:26.830489 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:26.831593 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:26.833300 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:26.834089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:26.835031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.051723 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.066677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-dfe12898-7e03-44d7-98ea-4e285212ec65 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.252357 Aug 31 09:50:27.068122 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 125/247] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:26 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:27.172701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:27.173302 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:27.181096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.181581 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.182004 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.182977 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.183724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.184410 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.447172 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.456315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.459136 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:27.460850 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-69b77173-dbe4-48a0-870e-623bbfd6d097 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.291945 Aug 31 09:50:27.461454 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 123/248] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:27 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:27.726089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:27.726605 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:27.739213 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.739728 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.740163 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:27.740871 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:27.741326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:27.741749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.084601 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.089232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:28.089837 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:28.093179 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-34ac5632-693a-4da2-a371-b20fa7c2135b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.371154 Aug 31 09:50:28.096685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.097307 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.098623 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.099424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.099881 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.100308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.103302 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 126/249] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:27 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:28.244146 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.252235 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-01c9413c-ac67-46a7-9308-71eb5988cde3 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.166654 Aug 31 09:50:28.252814 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 124/250] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:28 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:28.484898 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:28.485500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:28.491949 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.492355 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.492792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.493539 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:28.493941 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:28.494924 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:28.638991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.648158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.650059 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:28.651324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-733b8291-898d-4574-9852-596ed083839f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.169949 Aug 31 09:50:28.651647 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 127/251] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:28 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:29.116043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:29.116803 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:29.123397 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.123876 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.124313 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.125002 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.125448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.125869 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.261674 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.272296 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e3cbf3dc-0551-44bf-ad85-56366bfdd1a0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.161317 Aug 31 09:50:29.272884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 125/252] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:29 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:29.273070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:29.273700 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:29.279681 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.280107 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.280536 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.281277 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.281723 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.282140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.433970 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.446518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0bfc56cb-e3dc-41b7-b05f-90af7488d69a tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.177187 Aug 31 09:50:29.447552 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 128/253] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:29 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:29.677723 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:29.678794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:29.681931 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:29.691748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.692620 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.693381 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.694558 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:29.695404 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:29.696164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:29.865475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.878150 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.879815 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:29.881190 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5169d62f-1b41-4d20-ac11-da6f4cc2def6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.211483 Aug 31 09:50:29.881997 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 126/254] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:29 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:30.293384 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:30.294023 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:30.300520 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.301197 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.301645 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.302362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.302819 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.303301 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.446054 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:30.454600 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7270b7d4-6585-4dd7-8771-1f5f93c6976a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.165235 Aug 31 09:50:30.455207 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 129/255] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:30 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:30.476266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:30.477826 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:30.485210 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.485800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.486309 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.487080 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.487632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.488201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.491831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:30.628327 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:30.636593 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f8ce3e6d-7d91-445b-aa99-8bd770161e52 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.165610 Aug 31 09:50:30.637171 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 127/256] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:30 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:30.905068 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:30.905618 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:30.907624 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:30.908309 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:30.915116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.915627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.916070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:30.916784 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:30.917238 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:30.917658 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.002118 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=14 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:31.060132 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:31.068861 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:31.070319 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:31.071508 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6416325c-5a82-4228-91f7-f6d6ae0d920d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.170399 Aug 31 09:50:31.072248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 130/257] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:30 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:31.478662 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:31.479311 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:31.487622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.488136 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.488833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.489637 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.490206 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.490690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.627207 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:31.635481 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6830db31-4b7f-4a34-9fa4-2a4054d19527 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.161094 Aug 31 09:50:31.636128 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 128/258] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:31 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:31.659402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:31.660828 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:31.667923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.668421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.668860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.669602 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:31.670090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:31.670517 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:31.812820 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:31.831735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-001bbabb-228c-4809-b34d-05a4d9343ae1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.176342 Aug 31 09:50:31.833078 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 131/259] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:31 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:32.094971 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:32.095605 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:32.102633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:32.103138 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:32.103584 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:32.104281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:32.104732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:32.105154 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:32.271177 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:32.280813 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:32.282467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:32.283684 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6567fad0-926b-4ea1-ba2e-aab8bca4c6cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.192698 Aug 31 09:50:32.284356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 129/260] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:32 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:32.657962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:32.658540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:32.665710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:32.666266 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:32.666608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:32.667328 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:32.667787 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:32.668211 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:32.808927 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:32.817202 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b93d8ccc-5335-418f-9a10-2c1951fe22e4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.162588 Aug 31 09:50:32.817763 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 132/261] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:32 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:32.854698 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:32.855402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:32.862853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:32.864648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:32.865091 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:32.865811 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:32.866257 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:32.866686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.011420 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:33.021130 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a5a2e8d9-135d-4859-b83d-32426cf7b49c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.171024 Aug 31 09:50:33.021645 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 130/262] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:32 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:33.308278 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:33.308908 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:33.315811 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.316957 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.317518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.318244 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.318725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.319155 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.474789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:33.484122 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:33.485229 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:33.486528 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4d0528bb-092f-44f2-b2c4-41ddd2640fe5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.182498 Aug 31 09:50:33.487013 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 133/263] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:33 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:50:33.818028 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-ba89e0b1-9385-4d14-ba7c-74b7190f0830 req-c7c72e38-0a3a-493b-bcbc-0b6960a9bc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2236114-93d1-4533-8199-e77b5996f54d", "name": "network-vif-plugged", "status": "completed", "tag": "3d1efd6d-0e8a-4b38-8680-3725504f96c6"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:33.828400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-ba89e0b1-9385-4d14-ba7c-74b7190f0830 req-c7c72e38-0a3a-493b-bcbc-0b6960a9bc00 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.828958 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-ba89e0b1-9385-4d14-ba7c-74b7190f0830 req-c7c72e38-0a3a-493b-bcbc-0b6960a9bc00 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.829358 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-ba89e0b1-9385-4d14-ba7c-74b7190f0830 req-c7c72e38-0a3a-493b-bcbc-0b6960a9bc00 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.841402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:33.843030 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:33.846854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-ba89e0b1-9385-4d14-ba7c-74b7190f0830 req-c7c72e38-0a3a-493b-bcbc-0b6960a9bc00 service nova] Creating event network-vif-plugged:3d1efd6d-0e8a-4b38-8680-3725504f96c6 for instance e2236114-93d1-4533-8199-e77b5996f54d on hv-cinder-83754 Aug 31 09:50:33.854476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-ba89e0b1-9385-4d14-ba7c-74b7190f0830 req-c7c72e38-0a3a-493b-bcbc-0b6960a9bc00 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041104 Aug 31 09:50:33.854707 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.855210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.856141 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:33.857070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 131/264] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:33.858652 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:33.859785 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:33.861094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.043543 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:34.044250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:34.046148 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.052429 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.052909 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.053335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.054017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.054639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.054807 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-44d3c52f-829d-4382-82ae-36666ddcc0eb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.219489 Aug 31 09:50:34.055055 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.055429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 134/265] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:33 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:34.210924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.218644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-63784994-f5f0-4643-a21b-fd6db27ca0c1 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.179503 Aug 31 09:50:34.219231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 132/266] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:34 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:34.510606 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:34.511215 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:34.517214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.517699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.518132 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.518834 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:34.519332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:34.520334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:34.662601 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.672015 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.674343 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:34.678764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5bbfaa96-92a0-46f2-a919-6152ebdcea78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.169358 Aug 31 09:50:34.678764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 135/267] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:34 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:35.076858 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:35.077601 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:35.085214 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.085701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.086137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.086826 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.087319 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.087738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.227452 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:35.235488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-096bba95-0ef6-4798-bdbf-164981611e81 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.162420 Aug 31 09:50:35.236061 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 133/268] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:35 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:35.239950 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:35.240597 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:35.246483 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.246965 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.247428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.248116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.248568 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.248989 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.389712 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:35.391937 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:35.400316 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b8612d32-6739-4a38-a607-dfde7216e55c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.164409 Aug 31 09:50:35.401219 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 136/269] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:35 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:35.699200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:35.699854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:35.705887 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.706380 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.706857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.707934 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.708418 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.708857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.874032 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-fdf6534e-cf25-4ccf-bdfa-ac50354641f9 req-96a2ea02-2eb0-4b90-bada-eed1c08b000e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496af8f8-598e-4587-9b1f-6872ae150b60", "name": "network-vif-plugged", "status": "completed", "tag": "185bbce6-b13a-4073-98c3-a7f54eb93f1e"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:35.885437 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-fdf6534e-cf25-4ccf-bdfa-ac50354641f9 req-96a2ea02-2eb0-4b90-bada-eed1c08b000e service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:35.885971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-fdf6534e-cf25-4ccf-bdfa-ac50354641f9 req-96a2ea02-2eb0-4b90-bada-eed1c08b000e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:35.886610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-fdf6534e-cf25-4ccf-bdfa-ac50354641f9 req-96a2ea02-2eb0-4b90-bada-eed1c08b000e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:35.899821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-fdf6534e-cf25-4ccf-bdfa-ac50354641f9 req-96a2ea02-2eb0-4b90-bada-eed1c08b000e service nova] Creating event network-vif-plugged:185bbce6-b13a-4073-98c3-a7f54eb93f1e for instance 496af8f8-598e-4587-9b1f-6872ae150b60 on hv-cinder-83754 Aug 31 09:50:35.906117 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-fdf6534e-cf25-4ccf-bdfa-ac50354641f9 req-96a2ea02-2eb0-4b90-bada-eed1c08b000e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036532 Aug 31 09:50:35.906909 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 137/270] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:35.912113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:35.920699 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:35.922197 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:35.923378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6226b264-8780-4455-a633-a0f4f8735ccb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1407 microversion: 2.20 time: 0.228457 Aug 31 09:50:35.923935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 134/271] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:35 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:36.258417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:36.259142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:36.265810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.266304 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.266744 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.267505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.267963 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.268397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.424975 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:36.426922 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:36.436441 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:36.440392 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.441386 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.443148 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.444487 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.445316 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.446064 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.451436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ff22dcab-c8ed-47b1-9664-9aae4e321c77 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.197417 Aug 31 09:50:36.452181 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 138/272] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:36 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:36.642915 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:36.657307 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7bad35bb-cf45-4b42-8972-1c534e6c5aa4 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.238256 Aug 31 09:50:36.658471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 135/273] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:36 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:36.732772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ee918f19-0758-4aa3-a86b-463413f24f9a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:36.733261 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ee918f19-0758-4aa3-a86b-463413f24f9a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:36.739870 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee918f19-0758-4aa3-a86b-463413f24f9a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.740357 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee918f19-0758-4aa3-a86b-463413f24f9a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.740794 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee918f19-0758-4aa3-a86b-463413f24f9a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.741483 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee918f19-0758-4aa3-a86b-463413f24f9a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.741936 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee918f19-0758-4aa3-a86b-463413f24f9a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.742371 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee918f19-0758-4aa3-a86b-463413f24f9a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.772072 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ee918f19-0758-4aa3-a86b-463413f24f9a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/ips" status: 200 len: 144 microversion: 2.1 time: 0.043114 Aug 31 09:50:36.772654 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 139/274] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:50:36 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/ips => generated 144 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:36.947455 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:36.948232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:36.956009 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.957266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.957837 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:36.958731 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:36.959354 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:36.959970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.130905 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:37.139303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:37.140766 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:37.141953 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7c4aced1-b12d-41f6-9c5c-9a90b464f4a1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1598 microversion: 2.20 time: 0.199233 Aug 31 09:50:37.142512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 136/275] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:50:36 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1598 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:50:37.174247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a1275e47-2021-4ec1-b2cd-460175d3d9e9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:37.174868 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a1275e47-2021-4ec1-b2cd-460175d3d9e9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:37.184666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1275e47-2021-4ec1-b2cd-460175d3d9e9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.185463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1275e47-2021-4ec1-b2cd-460175d3d9e9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.186173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1275e47-2021-4ec1-b2cd-460175d3d9e9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.187479 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1275e47-2021-4ec1-b2cd-460175d3d9e9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.188265 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1275e47-2021-4ec1-b2cd-460175d3d9e9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.189002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1275e47-2021-4ec1-b2cd-460175d3d9e9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.310923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a1275e47-2021-4ec1-b2cd-460175d3d9e9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.142917 Aug 31 09:50:37.312570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 140/276] 10.222.0.36 () {60 vars in 1316 bytes} [Wed Aug 31 09:50:37 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:50:37.477567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:37.478583 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:37.486574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.487441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.488035 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.490017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.490573 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.491264 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.680492 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:37.681019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:37.687636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.688139 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.688575 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.689291 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:37.689753 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:37.690181 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:37.868097 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:37.877530 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b7e647df-a67a-4966-ba8e-d00116db53a2 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.201682 Aug 31 09:50:37.878119 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 141/277] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:37 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:37.939498 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:37.947622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-69fcef0e-dd9b-46b3-848d-5d92408abd4f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.475016 Aug 31 09:50:37.948301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 137/278] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:37 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:38.898805 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:38.900356 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:38.909182 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:38.910592 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:38.911407 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:38.912362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:38.913001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:38.913477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:38.985862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:38.989402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:39.008172 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.009127 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.010314 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.011794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.012853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.013713 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.130074 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:39.142627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b0e3284d-6d84-4a32-adf0-c588fe796ed5 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1313 microversion: 2.1 time: 0.248351 Aug 31 09:50:39.143699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 142/279] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:38 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:39.309124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-aadc7371-873a-4cad-a37a-ebd1c6954fd7 req-20553be0-7b12-4641-a78f-973a03443f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2236114-93d1-4533-8199-e77b5996f54d", "tag": "3d1efd6d-0e8a-4b38-8680-3725504f96c6"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:39.321476 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-aadc7371-873a-4cad-a37a-ebd1c6954fd7 req-20553be0-7b12-4641-a78f-973a03443f13 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:39.322261 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-aadc7371-873a-4cad-a37a-ebd1c6954fd7 req-20553be0-7b12-4641-a78f-973a03443f13 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:39.322972 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-aadc7371-873a-4cad-a37a-ebd1c6954fd7 req-20553be0-7b12-4641-a78f-973a03443f13 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:39.323238 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:39.331175 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a8c22def-afd8-43d4-abc9-84dec94e7804 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.364304 Aug 31 09:50:39.333642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 138/280] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:38 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:39.338567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-aadc7371-873a-4cad-a37a-ebd1c6954fd7 req-20553be0-7b12-4641-a78f-973a03443f13 service nova] Creating event network-changed:3d1efd6d-0e8a-4b38-8680-3725504f96c6 for instance e2236114-93d1-4533-8199-e77b5996f54d on hv-cinder-83754 Aug 31 09:50:39.348895 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-aadc7371-873a-4cad-a37a-ebd1c6954fd7 req-20553be0-7b12-4641-a78f-973a03443f13 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045264 Aug 31 09:50:39.350055 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 143/281] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:50:40.164878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:40.166341 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:40.179758 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.180333 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.180768 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.181479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.185699 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.186198 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.270604 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-02b19338-d5fd-4289-b113-2e8444dff7c5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:40.271675 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-02b19338-d5fd-4289-b113-2e8444dff7c5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:40.288895 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02b19338-d5fd-4289-b113-2e8444dff7c5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.290162 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02b19338-d5fd-4289-b113-2e8444dff7c5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.291106 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02b19338-d5fd-4289-b113-2e8444dff7c5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.292094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02b19338-d5fd-4289-b113-2e8444dff7c5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.292768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02b19338-d5fd-4289-b113-2e8444dff7c5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.293400 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02b19338-d5fd-4289-b113-2e8444dff7c5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.350489 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-02b19338-d5fd-4289-b113-2e8444dff7c5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/ips" status: 200 len: 149 microversion: 2.1 time: 0.087507 Aug 31 09:50:40.363921 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 144/282] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:50:40 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/ips => generated 149 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:40.370090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:40.370800 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:40.399022 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.399572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.400181 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.401456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.402164 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.402778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.436977 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:40.449846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-99b7dbe5-03ab-4229-a290-09494b8c5a7c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1463 microversion: 2.1 time: 0.289397 Aug 31 09:50:40.451145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 139/283] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:40 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1463 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:40.558395 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:40.558947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:40.568002 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.568548 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.568980 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.569685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.570391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.570985 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.627590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:50:40.715236 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:40.755795 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8ea10f86-ec43-409e-aa35-1cbac11bf3fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.381425 Aug 31 09:50:40.757199 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 145/284] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:40 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:40.920027 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-af01f813-e407-4f5c-8813-4f41f9de04af tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "DELETE /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 204 len: 0 microversion: 2.1 time: 0.369352 Aug 31 09:50:40.924038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 140/285] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:50:40 2022] DELETE /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:50:40.939646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:40.940643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:40.960807 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.962220 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.965247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:40.965836 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:40.966612 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:40.969184 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:41.264831 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:41.289466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f47e8aa1-0e37-4fd5-9aec-82ae5b38a806 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1469 microversion: 2.1 time: 0.346811 Aug 31 09:50:41.290698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 146/286] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:40 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1469 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:41.787585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:41.789075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:41.801694 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.802881 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.808583 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:41.810693 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:41.811889 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:41.813100 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:41.991917 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:42.002910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-719473b8-3f8b-440f-8e9b-0f43a6cbf7cd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.225721 Aug 31 09:50:42.003698 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 141/287] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:41 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:42.188520 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-50cbf1aa-0e11-41cc-9070-040f776ca26d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee69d147-bc03-4f51-8abd-cfe154cc7184"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:42.191726 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-50cbf1aa-0e11-41cc-9070-040f776ca26d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:42.198071 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50cbf1aa-0e11-41cc-9070-040f776ca26d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.198552 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50cbf1aa-0e11-41cc-9070-040f776ca26d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.198988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50cbf1aa-0e11-41cc-9070-040f776ca26d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.199836 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50cbf1aa-0e11-41cc-9070-040f776ca26d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.208090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50cbf1aa-0e11-41cc-9070-040f776ca26d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.209046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50cbf1aa-0e11-41cc-9070-040f776ca26d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.312393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:42.312995 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:42.322100 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.323199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.323687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.325504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.325962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.326391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.530532 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:42.534451 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:42.543903 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b4eb0572-27f0-4657-8bf0-bf0ca928486b tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1469 microversion: 2.1 time: 0.235496 Aug 31 09:50:42.545501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 142/288] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:42 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1469 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:42.568738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-98afe4aa-9c96-49cb-8af5-b6adbc122c47 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c912c92-8a95-474a-96a1-b9028441ba13"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:42.571280 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-98afe4aa-9c96-49cb-8af5-b6adbc122c47 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:42.579778 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98afe4aa-9c96-49cb-8af5-b6adbc122c47 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.580300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98afe4aa-9c96-49cb-8af5-b6adbc122c47 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.580841 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98afe4aa-9c96-49cb-8af5-b6adbc122c47 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:42.582076 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98afe4aa-9c96-49cb-8af5-b6adbc122c47 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:42.583199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98afe4aa-9c96-49cb-8af5-b6adbc122c47 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:42.583692 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98afe4aa-9c96-49cb-8af5-b6adbc122c47 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.683634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-50cbf1aa-0e11-41cc-9070-040f776ca26d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.499593 Aug 31 09:50:43.684789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 147/289] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:50:42 2022] POST /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments => generated 194 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:50:43.703986 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-98afe4aa-9c96-49cb-8af5-b6adbc122c47 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.140641 Aug 31 09:50:43.705108 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 143/290] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:50:42 2022] POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/os-volume_attachments => generated 194 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:43.714672 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:43.716039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:43.728285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.729066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.731168 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.731958 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.732926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.734105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.755525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:43.756713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:43.793729 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.805534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.805854 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:43.806762 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:43.807336 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:43.808707 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:44.042990 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:44.067531 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-07ca4bea-ef70-4c14-8217-2fa7c042fbda tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1469 microversion: 2.1 time: 0.357013 Aug 31 09:50:44.068507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 144/291] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:43 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1469 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:44.186344 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:44.200404 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-538a3d96-2f1f-457d-ae1a-7bddee7e3d53 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.513795 Aug 31 09:50:44.202584 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 148/292] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:43 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:44.465389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-c6a698a9-35a5-4f2e-b262-d935e05441be req-7d5e5483-c6fc-42ac-a07c-5e3f5f19a151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496af8f8-598e-4587-9b1f-6872ae150b60", "name": "network-vif-deleted", "tag": "185bbce6-b13a-4073-98c3-a7f54eb93f1e"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:44.502455 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-c6a698a9-35a5-4f2e-b262-d935e05441be req-7d5e5483-c6fc-42ac-a07c-5e3f5f19a151 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:44.504608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-c6a698a9-35a5-4f2e-b262-d935e05441be req-7d5e5483-c6fc-42ac-a07c-5e3f5f19a151 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:44.506441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-c6a698a9-35a5-4f2e-b262-d935e05441be req-7d5e5483-c6fc-42ac-a07c-5e3f5f19a151 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:44.531453 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-c6a698a9-35a5-4f2e-b262-d935e05441be req-7d5e5483-c6fc-42ac-a07c-5e3f5f19a151 service nova] Creating event network-vif-deleted:185bbce6-b13a-4073-98c3-a7f54eb93f1e for instance 496af8f8-598e-4587-9b1f-6872ae150b60 on hv-cinder-83754 Aug 31 09:50:44.541279 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-c6a698a9-35a5-4f2e-b262-d935e05441be req-7d5e5483-c6fc-42ac-a07c-5e3f5f19a151 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093960 Aug 31 09:50:44.546504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 145/293] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:45.090609 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:45.091377 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:45.099942 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.101119 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.101788 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.102754 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.103467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.104580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.187402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.188310 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.189545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.190202 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lazy-loading 'fault' on Instance uuid 496af8f8-598e-4587-9b1f-6872ae150b60 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:50:45.242613 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:45.242613 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:45.261582 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.262859 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.263710 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.264839 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:45.265744 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:45.266453 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:45.307353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '646da13f9db94b0fa2302d6b45774e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c88af70f29db4015a6fce06089debe5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:45.332621 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f1cf23b1-a55f-408e-87d0-578beb056051 tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 200 len: 1303 microversion: 2.1 time: 0.244758 Aug 31 09:50:45.333699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 149/294] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:45 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 1303 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:45.565714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:45.579501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a4f15029-df94-48ba-b896-1d161f0ece88 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.356994 Aug 31 09:50:45.580476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 146/295] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:45 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:46.362275 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:46.365724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] [instance: 496af8f8-598e-4587-9b1f-6872ae150b60] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:46.381599 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.383412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.384586 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.386829 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.387983 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.389001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.426154 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] HTTP exception thrown: Instance 496af8f8-598e-4587-9b1f-6872ae150b60 could not be found. Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Request method failure captured: Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 HTTP/1.1 Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy7ZVmqWqTxeS331niKIQs02BnpN1jopMXSDD_55F51mfXqa64MbzM70VHt61yURDO3ydLJfeeDff7y1mXAu7XauYo6lRhtTRkktFsq646T31qI5OzO4oJGt-uVGlCktyXETmlv4CeOq5NwgBhNSdINVKXa2cY5oDlMQueVFALUgTks Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c88af70f29db4015a6fce06089debe5c Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-VolumesNegativeTest-1534593682 Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:50:46.430085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c88af70f29db4015a6fce06089debe5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c88af70f29db4015a6fce06089debe5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c88af70f29db4015a6fce06089debe5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c88af70f29db4015a6fce06089debe5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-VolumesNegativeTest-1534593682 Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c88af70f29db4015a6fce06089debe5c Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-VolumesNegativeTest-1534593682 Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-VolumesNegativeTest-1534593682-project Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 646da13f9db94b0fa2302d6b45774e54 Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-VolumesNegativeTest-1534593682-project Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 496af8f8-598e-4587-9b1f-6872ae150b60 could not be found. Aug 31 09:50:46.444444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '496af8f8-598e-4587-9b1f-6872ae150b60'} Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 496af8f8-598e-4587-9b1f-6872ae150b60 could not be found. Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:50:46.447005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 496af8f8-598e-4587-9b1f-6872ae150b60 could not be found. Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 496af8f8-598e-4587-9b1f-6872ae150b60 could not be found. Aug 31 09:50:46.451585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:46.455445 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] Returning 404 to user: Instance 496af8f8-598e-4587-9b1f-6872ae150b60 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:50:46.455445 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b612e349-83e0-421e-8f3b-73df99ee480c tempest-VolumesNegativeTest-1534593682 tempest-VolumesNegativeTest-1534593682-project] 10.222.0.36 "GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60" status: 404 len: 111 microversion: 2.1 time: 0.085724 Aug 31 09:50:46.456611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 150/296] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:46 2022] GET /compute/v2.1/servers/496af8f8-598e-4587-9b1f-6872ae150b60 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:50:46.608503 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:46.609750 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:46.622178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.623512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.624344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:46.625684 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:46.626794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:46.627648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:47.013806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:47.023216 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1ad03f14-4d12-4285-b315-d8a84d8aef2c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.422557 Aug 31 09:50:47.023805 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 147/297] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:46 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:48.053667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:48.057406 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:48.078996 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.082462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.083626 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:48.085884 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:48.088204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:48.093370 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:48.392743 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:48.406730 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c92e356c-1abe-4a37-b6cd-113df82aac78 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.362722 Aug 31 09:50:48.426353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 151/298] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:48 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:49.438635 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:49.441460 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:49.453129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:49.453755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:49.454674 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:49.458348 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:49.458348 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:49.458348 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:49.714549 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:49.727011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ad5ed0e8-af36-4d39-8374-e92ed28053c1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.296062 Aug 31 09:50:49.731166 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 148/299] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:49 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:50.752738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:50.753567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:50.765514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.766117 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.766659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:50.768585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:50.770299 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:50.771056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:51.010640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:51.023934 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a69e31df-b0bd-4f00-9169-cb96e55d5e6e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.274887 Aug 31 09:50:51.024882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 152/300] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:50 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:52.055211 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:52.055916 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:52.069755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.070455 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.071082 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.072259 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.072955 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.073442 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.259168 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:52.270861 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1a1c6017-04f7-4e72-8903-1d76bc272533 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1501 microversion: 2.1 time: 0.220779 Aug 31 09:50:52.271856 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 149/301] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:52 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:52.315763 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "429d9425-a5c8-4221-9741-2892b3131372"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:52.332861 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:52.359620 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.360462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.361227 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.363895 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.364730 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.365456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.437027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] HTTP exception thrown: Cannot 'attach_volume' instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c while it is in vm_state rescued Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Request method failure captured: Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: POST /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c/os-volume_attachments HTTP/1.1 Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 74 Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy5w7w6erjIccgUn-R2MYFy0wkKrnLBZ8G0LGzYBZIz-xcb-8Yn8UHnEdSssEMHV_zHLnUCz5n-M6ZjRm_k6YKV_oUnpLJFvOHsBqUCszrB3lOV_RHTzo8YIEsVmnEd7B9ET6Gqe4YcmIzrJ5bZ1232bHyDzwV1FphlF0D2Y1EIcJzk Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:50:52.442051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: b8818863a81b4238a22035fbb256568e Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {"volumeAttachment": {"volumeId": "429d9425-a5c8-4221-9741-2892b3131372"}} Aug 31 09:50:52.445152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Cannot 'attach_volume' instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c while it is in vm_state rescued Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'server_id': '52ff3858-3242-45d8-ad69-757d5b9c6d7c', 'body': {'volumeAttachment': {'volumeId': '429d9425-a5c8-4221-9741-2892b3131372'}}} Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:50:52.446990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c while it is in vm_state rescued Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:50:52.452399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:50:52.460722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:50:52.460722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:50:52.460722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c while it is in vm_state rescued Aug 31 09:50:52.460722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:50:52.460722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Returning 409 to user: Cannot 'attach_volume' instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c while it is in vm_state rescued {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:50:52.460722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e2b00638-c577-4897-99f6-9c7d834b4e0d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.146373 Aug 31 09:50:52.460722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 153/302] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:50:52 2022] POST /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c/os-volume_attachments => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 09:50:52.464736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b42e5fd8-b615-4800-9afa-5225dd6ed84d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:52.468193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b42e5fd8-b615-4800-9afa-5225dd6ed84d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:52.490796 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b42e5fd8-b615-4800-9afa-5225dd6ed84d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.496185 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b42e5fd8-b615-4800-9afa-5225dd6ed84d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.497375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b42e5fd8-b615-4800-9afa-5225dd6ed84d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.499534 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b42e5fd8-b615-4800-9afa-5225dd6ed84d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.500344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b42e5fd8-b615-4800-9afa-5225dd6ed84d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.501744 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b42e5fd8-b615-4800-9afa-5225dd6ed84d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.705696 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b42e5fd8-b615-4800-9afa-5225dd6ed84d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c/action" status: 202 len: 0 microversion: 2.1 time: 0.249885 Aug 31 09:50:52.708380 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 150/303] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:50:52 2022] POST /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:50:52.737212 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:52.741167 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:52.775493 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.787002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.787971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:52.796177 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:52.797180 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:52.797974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.246975 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:53.261898 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1f619f28-f99c-4d1a-b283-e42b83b7d4da tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1509 microversion: 2.1 time: 0.547175 Aug 31 09:50:53.268195 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 154/304] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:52 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1509 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:53.350630 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6865c600-db1c-4c17-a66d-91697477642a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:53.365337 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6865c600-db1c-4c17-a66d-91697477642a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:53.366404 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6865c600-db1c-4c17-a66d-91697477642a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:53.367095 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6865c600-db1c-4c17-a66d-91697477642a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.463900 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6865c600-db1c-4c17-a66d-91697477642a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Going to try to stop instance {{(pid=132570) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 09:50:53.553479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6865c600-db1c-4c17-a66d-91697477642a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/action" status: 202 len: 0 microversion: 2.1 time: 0.207784 Aug 31 09:50:53.554603 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 151/305] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:50:53 2022] POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:50:53.566592 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:53.568987 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:53.581033 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:53.582405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:53.583271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.584553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:53.585234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:53.586355 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:53.594250 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:54.071603 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:54.088232 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6a8c37ad-15f7-422c-92db-6194e8e3dfc7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.526364 Aug 31 09:50:54.092625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 155/306] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:53 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:54.293053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:54.293797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:54.306372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:54.306901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:54.307375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:54.308123 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:54.309605 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:54.310076 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:54.575102 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:54.593906 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-14bc1a8c-53e1-4bff-928c-3a8e41629235 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1509 microversion: 2.1 time: 0.306241 Aug 31 09:50:54.611558 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 152/307] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:54 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:55.116814 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:55.117659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:55.131432 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:55.132598 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:55.133525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:55.135046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:55.136416 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:55.137613 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:55.431004 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:55.451537 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6c9834ae-6b62-48de-9744-cf6245f9bdf2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.339777 Aug 31 09:50:55.453547 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 156/308] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:55 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:55.640934 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:55.643049 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:55.656656 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:55.657855 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:55.658602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:55.659985 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:55.660731 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:55.661610 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:55.894385 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:55.903711 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ea884e37-d55a-4ef2-bdb9-e3759694df17 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1509 microversion: 2.1 time: 0.270251 Aug 31 09:50:55.904323 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 153/309] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:55 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:56.494132 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:56.495820 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:56.514244 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:56.515322 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:56.522664 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:56.523615 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:56.524274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:56.524876 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:56.781518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:56.805425 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0df8baf0-91b0-4b4c-8d8d-d203f11fa13d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.316503 Aug 31 09:50:56.823493 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 157/310] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:56 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:56.959788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:56.961371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:56.994473 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:56.995714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:56.996748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:56.998651 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:56.999705 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:57.000659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:57.529112 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:57.557426 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3753d043-8c86-4b76-8de6-b4b83a1665e3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1515 microversion: 2.1 time: 0.602135 Aug 31 09:50:57.573852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 154/311] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:56 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1515 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:50:57.845306 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:57.846096 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:57.858116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:57.858992 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:57.865554 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:57.867070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:57.867774 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:57.868293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:58.695731 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:50:58.710906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8048fc63-78cd-4d20-a089-f93de4c43d5c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.870179 Aug 31 09:50:58.711554 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 158/312] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:57 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:50:59.534298 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d71cdec5-a9fc-49e8-987a-20b4da2cde8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'create', calling method: .version_select at 0x7f9462bd4670>, body: {"keypair": {"name": "tempest-keypair-1979349837", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLYR8jrRxobsvf2bbPJLvhUlXa6Xfs27mlZMElzt/nzt0O+eUmBAWBY6md1gVnhen18xlA3X9FTnQu/CnDFuzUDPZyVR1alEVb3C5gjQcmU+dnC1PkyQAvd7ndiGweKmg=="}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:50:59.572546 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-d71cdec5-a9fc-49e8-987a-20b4da2cde8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Getting quotas for project bfef7bc61a644c12a42cc17b1aed1b31. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:50:59.578035 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-d71cdec5-a9fc-49e8-987a-20b4da2cde8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Getting quotas for user b8818863a81b4238a22035fbb256568e and project bfef7bc61a644c12a42cc17b1aed1b31. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:50:59.608079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d71cdec5-a9fc-49e8-987a-20b4da2cde8c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079617 Aug 31 09:50:59.609473 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 155/313] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:50:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:50:59.743693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:50:59.744483 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:50:59.759421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:59.760316 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:59.763337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:50:59.765863 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:50:59.769163 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:50:59.771071 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:00.213727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-69ee38d6-e5a6-4ec9-b8ff-9179c01bbc84 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: .version_select at 0x7f9462d24940>, body: {"keypair": {"name": "tempest-keypair-2011448916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaNrCWZHaLcswRwJux7Yv6kbRw+xfRiAIn0IZSd+shyevSqEhkqCGmgS7d2Czj4xeuGvczAfuZQ+qaEFyh09sfylJhd1BktVkHKcC/x1z5W+wsMIEjBnfJxo9F9y1qgng=="}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:00.221702 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:00.260056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-69ee38d6-e5a6-4ec9-b8ff-9179c01bbc84 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for project c4914faafb494e5bb323114853f25c54. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:51:00.267096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-69ee38d6-e5a6-4ec9-b8ff-9179c01bbc84 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for user 980ab18eb5c646378d738079621a0dbc and project c4914faafb494e5bb323114853f25c54. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:51:00.342304 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-69ee38d6-e5a6-4ec9-b8ff-9179c01bbc84 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133588 Aug 31 09:51:00.343959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 156/314] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:51:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:00.458451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:00.471452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c88245ce-4f4c-4db2-94b4-5daf0027913d tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.733843 Aug 31 09:51:00.485669 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 159/315] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:50:59 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:01.494385 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:01.496221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:01.503427 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:01.504323 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:01.504944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:01.505666 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:01.506275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:01.506861 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:01.838464 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:01.849511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-917a4e12-d38f-437c-b0f8-6c7561ee90c7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.358572 Aug 31 09:51:01.859289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 157/316] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:01 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:02.793879 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-653019962", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5fb2c2c-d2a5-4039-a42c-96d968ac091e"}], "security_groups": [{"name": "tempest-securitygroup--646631061"}], "key_name": "tempest-keypair-2011448916", "user_data": "}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:02.824913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=62 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:02.879955 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:02.882111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:02.892230 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:02.893085 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:02.894707 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:02.896024 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:02.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:02.897600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:03.007145 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] validate_networks() for [('c5fb2c2c-d2a5-4039-a42c-96d968ac091e', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:51:03.221290 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:03.229304 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:03.233334 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-be1243b9-187e-4f40-af6f-f60a625063e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.362887 Aug 31 09:51:03.235016 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 158/317] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:02 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:03.242172 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-680643335", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d29a8f85-a955-420e-adfc-3d7c1f060852"}], "security_groups": [{"name": "tempest-securitygroup--1002770878"}], "key_name": "tempest-keypair-1979349837", "user_data": "}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:03.477006 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.network.neutron [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] validate_networks() for [('d29a8f85-a955-420e-adfc-3d7c1f060852', None, None, None, None, None)] {{(pid=132570) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:51:03.552623 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:51:03.553340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:51:03.553983 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:51:03.554550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:51:03.555112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:51:03.567402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:03.567879 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:03.568505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:03.569361 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:03.570000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:03.570678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:03.589516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for project c4914faafb494e5bb323114853f25c54. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:51:03.595773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for user 980ab18eb5c646378d738079621a0dbc and project c4914faafb494e5bb323114853f25c54. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:51:03.615659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:51:03.618456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:51:03.677914 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9ecd8334-e760-41f5-bab9-ad390d62bea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.889520 Aug 31 09:51:03.678700 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 160/318] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:51:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:51:03.689775 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-879ea14d-bd01-462a-a5b3-fa9a56fd51da tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:03.691364 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-879ea14d-bd01-462a-a5b3-fa9a56fd51da tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:03.751868 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-879ea14d-bd01-462a-a5b3-fa9a56fd51da tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:03.761201 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-879ea14d-bd01-462a-a5b3-fa9a56fd51da tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1241 microversion: 2.1 time: 0.075222 Aug 31 09:51:03.762391 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 161/319] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:03 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:04.257573 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:04.258780 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:04.265980 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.266475 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.267011 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.267843 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.268931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.269428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.467096 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:04.478699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9238eb01-a4ee-49a7-88eb-504bd427c404 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.226138 Aug 31 09:51:04.479499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 162/320] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:04 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:04.539330 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Flavor limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:51:04.540089 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Image limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:51:04.540351 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Flavor pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:51:04.540856 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Image pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:51:04.541274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:51:04.552107 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.552517 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.552959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.554482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.554482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.554733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.576982 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Getting quotas for project bfef7bc61a644c12a42cc17b1aed1b31. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:51:04.588023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Getting quotas for user b8818863a81b4238a22035fbb256568e and project bfef7bc61a644c12a42cc17b1aed1b31. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:51:04.619535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Going to run 1 instances... {{(pid=132570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:51:04.623656 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:51:04.702255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f6734392-3c27-49d9-b710-98f9f55bb468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.465907 Aug 31 09:51:04.703413 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 159/321] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:51:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:51:04.720088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c714ebed-9d89-4dc0-a848-b0cedf379219 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:04.720976 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c714ebed-9d89-4dc0-a848-b0cedf379219 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:04.793668 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:04.795414 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:04.814434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.814825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.816260 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.817756 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:04.818616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:04.822181 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:04.843301 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c714ebed-9d89-4dc0-a848-b0cedf379219 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:04.855792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c714ebed-9d89-4dc0-a848-b0cedf379219 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1245 microversion: 2.1 time: 0.142580 Aug 31 09:51:04.864934 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 163/322] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:04 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1245 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:04.926460 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:04.936933 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2ab5ea95-2fc5-4719-a97a-4556d8e2c429 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1245 microversion: 2.1 time: 0.157253 Aug 31 09:51:04.937559 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 160/323] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:04 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1245 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:05.519575 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:05.520923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:05.529875 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.530870 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.531664 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.532689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.534192 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.534800 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.850540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:05.863099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-052eef84-c4dd-4307-bed5-b24a7936614a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.351451 Aug 31 09:51:05.864077 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 164/324] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:05 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:05.882991 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:05.887317 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:05.901373 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.901831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.902319 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.903086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.903569 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.904305 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.964652 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:05.965519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:05.975693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.976186 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.976621 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:05.977335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:05.977791 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:05.978218 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:06.066025 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:06.086175 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a8484bb5-eaa5-4284-b31b-93f42be6f57c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1241 microversion: 2.1 time: 0.210904 Aug 31 09:51:06.086813 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 161/325] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:05 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1241 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:06.125583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:06.140692 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fca4f749-9bac-48ab-8b23-caec9fb24ac8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1293 microversion: 2.1 time: 0.186650 Aug 31 09:51:06.143626 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 165/326] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:05 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1293 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:06.901676 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:06.902884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:06.911848 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:06.913057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:06.913500 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:06.914271 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:06.914727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:06.915168 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:07.095632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:07.114806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6838abb9-92d0-46fe-aecc-f295b9db66d7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.217929 Aug 31 09:51:07.131398 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 162/327] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:06 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:07.133647 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:07.136375 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:07.157073 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:07.157622 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:07.158424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:07.160243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:07.161354 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:07.162177 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:07.184089 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:07.184883 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:07.208655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:07.209178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:07.213305 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:07.214180 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:07.214679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:07.215152 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:07.308574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:07.316049 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:07.318181 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b5934427-cb97-4a84-a5a6-f3c6ea0cf5ad tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1299 microversion: 2.1 time: 0.140224 Aug 31 09:51:07.319305 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 163/328] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:07 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:07.387355 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c90d7ece-b8ab-4943-94c1-0ede5d14b2b5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1297 microversion: 2.1 time: 0.256137 Aug 31 09:51:07.388040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 166/329] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:07 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1297 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:08.139545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:08.140775 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:08.151424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.152247 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.152917 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.153852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.154549 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.155240 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.361569 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:08.363502 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:08.381595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.382371 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.383004 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.383982 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.384637 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.385268 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.483944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:08.513386 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5212dd9b-8772-4c15-96bd-c78251590c0b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.377502 Aug 31 09:51:08.526213 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 164/330] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:08 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:08.543989 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:08.544958 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:08.553913 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.558191 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:08.559652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.561769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.564167 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:08.565864 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:08.567654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:08.573878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4ba77b5b-2720-4406-b0d7-54209145a5a2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1299 microversion: 2.1 time: 0.217324 Aug 31 09:51:08.575112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 167/331] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:08 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1299 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:08.730197 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:08.763471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-31830352-a39a-428b-b961-dfbd0f52237c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1297 microversion: 2.1 time: 0.222286 Aug 31 09:51:08.766075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 165/332] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:08 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1297 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:09.544122 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:09.544919 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:09.560583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.560583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.560891 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:09.561747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.562297 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.562795 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:09.599415 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:09.600868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:09.612597 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.616916 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.617368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:09.621926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.621926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.621926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:09.737568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:09.751196 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d61c7e8b-38d6-4f0b-b5bd-4ae3b4f6bc77 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1299 microversion: 2.1 time: 0.155867 Aug 31 09:51:09.755956 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 166/333] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:09 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:09.801846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:09.806150 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:09.841552 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.842502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.843246 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:09.844255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:09.844898 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:09.845965 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:09.942119 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:09.956712 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-636c411d-b1b5-41c6-ae6d-20864e1152d3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1297 microversion: 2.1 time: 0.163606 Aug 31 09:51:09.961213 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 167/334] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:09 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1297 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:10.463810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:10.489309 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-73a61592-470a-4a99-99c6-1fb4d0e617cb tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.948615 Aug 31 09:51:10.497246 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 168/335] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:09 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:10.815886 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:10.823321 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:10.846158 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:10.847206 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:10.847817 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:10.848997 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:10.851971 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:10.852762 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:10.973932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:10.984190 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f6a6ceaf-4fdb-4acc-959b-71cd0d4fb3b2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1299 microversion: 2.1 time: 0.189568 Aug 31 09:51:10.985587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 168/336] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:10 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:10.988770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:10.992174 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:11.060032 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:11.061154 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:11.061985 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:11.063141 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:11.064089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:11.064711 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:11.264736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:11.290157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-97909594-7080-4222-81cc-0275310f1b5a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1303 microversion: 2.1 time: 0.311631 Aug 31 09:51:11.291644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 169/337] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:10 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1303 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:11.527359 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:11.528525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:11.538165 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:11.538960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:11.539758 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:11.540704 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:11.541496 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:11.542691 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:11.855790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:11.872369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4e29ccc0-a7ba-43e2-942e-9eb7641bb4e1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.355605 Aug 31 09:51:11.873797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 169/338] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:11 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:12.012727 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:12.013764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:12.025488 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.026678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.027397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:12.028445 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.029522 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.030307 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:12.319072 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:12.319730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:12.333835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.334238 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.336441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:12.337200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.337687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.338105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:12.403424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:12.418626 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f287ffa3-225e-45a4-ba17-54b8b22db2ed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.411473 Aug 31 09:51:12.435934 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 170/339] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:12 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:12.609333 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:12.619775 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d5c61515-df4d-436c-b629-832fa46b1d84 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1371 microversion: 2.1 time: 0.309027 Aug 31 09:51:12.620569 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 170/340] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:12 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1371 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:12.915354 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:12.916858 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:12.936172 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.936554 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.937075 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:12.937896 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:12.938433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:12.938933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.327722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:13.343018 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a3f5ffc5-7804-4503-8a21-1613ab0ad723 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.435424 Aug 31 09:51:13.344318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 171/341] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:12 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:13.468423 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:13.469682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:13.478772 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:13.479597 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:13.480136 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.481114 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:13.481702 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:13.482162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.644088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:13.646544 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:13.648785 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:13.657663 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:13.660987 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:13.664233 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.666859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:13.667402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:13.667862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:13.713688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:13.740628 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ae03dabb-4097-4237-8386-1e4fabbc3b3d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.276641 Aug 31 09:51:13.760679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 171/342] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:13 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:13.858495 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:13.868249 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6e9c1010-e875-4e75-9018-3c63790e543e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1371 microversion: 2.1 time: 0.229780 Aug 31 09:51:13.869047 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 172/343] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:13 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:14.266624 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0e88831c-1e1e-4844-90bc-cec9a3949301 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Action: 'create', calling method: .version_select at 0x7f9462d3e550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-790377107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6HkoNE7EE4w3S5hza/c3j9j8BhJmz5XVt8JDuwE5GcaOtHIwpsWh1yZEQBAGUIqTsvRkg4fYeem0+AwCoUP1DIimq00RFMdTBe697e5BaYujzKTntB/BCQraUjaH/JiA=="}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:14.298117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-0e88831c-1e1e-4844-90bc-cec9a3949301 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Getting quotas for project 9f1c2adbca494a53a24033b674c2762c. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:51:14.307110 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-0e88831c-1e1e-4844-90bc-cec9a3949301 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Getting quotas for user 893e06c5ea99497fae2847399b7a1a3c and project 9f1c2adbca494a53a24033b674c2762c. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:51:14.354179 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0e88831c-1e1e-4844-90bc-cec9a3949301 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.422331 Aug 31 09:51:14.354970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 172/344] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:51:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:51:14.375750 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:14.376990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:14.384555 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:14.385138 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:14.385641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:14.386494 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:14.387416 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:14.387913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:14.782161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:14.782878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:14.785713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:14.793025 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:14.794536 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-eaecb918-f687-44b5-9817-0e488a328475 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1722 microversion: 2.1 time: 0.424101 Aug 31 09:51:14.810066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:14.810066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:14.810066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:14.810066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:14.810594 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:14.810594 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:14.810827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 173/345] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:14 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1722 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:14.816723 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-79dc4762-e701-443b-af5b-cc21ff0ece04 req-f50b4247-1c3f-456a-b13a-1b29768b859b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ffd309-4ae6-48c6-ac5d-740538eee04a", "tag": "0527b895-2177-4cb0-9f5a-08f0343398af"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:14.834976 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-79dc4762-e701-443b-af5b-cc21ff0ece04 req-f50b4247-1c3f-456a-b13a-1b29768b859b service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:14.836546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-79dc4762-e701-443b-af5b-cc21ff0ece04 req-f50b4247-1c3f-456a-b13a-1b29768b859b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:14.837340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-79dc4762-e701-443b-af5b-cc21ff0ece04 req-f50b4247-1c3f-456a-b13a-1b29768b859b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:14.852976 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=10 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:14.855742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-79dc4762-e701-443b-af5b-cc21ff0ece04 req-f50b4247-1c3f-456a-b13a-1b29768b859b service nova] Creating event network-changed:0527b895-2177-4cb0-9f5a-08f0343398af for instance d2ffd309-4ae6-48c6-ac5d-740538eee04a on hv-cinder-83754 Aug 31 09:51:14.863706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-79dc4762-e701-443b-af5b-cc21ff0ece04 req-f50b4247-1c3f-456a-b13a-1b29768b859b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049348 Aug 31 09:51:14.867082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 174/346] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:14.902656 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:14.904173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:14.929197 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:14.930039 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:14.930757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:14.932258 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:14.933086 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:14.933686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:14.948613 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=100 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:15.149712 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:15.170021 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a5919ee3-a66b-434f-b30c-428d535abea3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.392703 Aug 31 09:51:15.171323 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 173/347] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:14 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:15.430900 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:15.443173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-29c1db5c-225c-4e16-8cac-97c56733ef2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1371 microversion: 2.1 time: 0.546900 Aug 31 09:51:15.444351 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 175/348] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:14 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1371 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:15.475414 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-b6982e60-b0dc-4273-ad85-11cd1263765d req-4fe77d7f-906a-4410-bd25-454a9c741423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f44622-25b4-4470-85c3-bb4c09cbea6a", "tag": "193dcc74-523a-4cee-9f3e-460cdd4133e0"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:15.504729 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-b6982e60-b0dc-4273-ad85-11cd1263765d req-4fe77d7f-906a-4410-bd25-454a9c741423 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:15.505622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-b6982e60-b0dc-4273-ad85-11cd1263765d req-4fe77d7f-906a-4410-bd25-454a9c741423 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:15.506057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-b6982e60-b0dc-4273-ad85-11cd1263765d req-4fe77d7f-906a-4410-bd25-454a9c741423 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:15.533617 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-b6982e60-b0dc-4273-ad85-11cd1263765d req-4fe77d7f-906a-4410-bd25-454a9c741423 service nova] Creating event network-changed:193dcc74-523a-4cee-9f3e-460cdd4133e0 for instance 02f44622-25b4-4470-85c3-bb4c09cbea6a on hv-cinder-83754 Aug 31 09:51:15.544188 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-b6982e60-b0dc-4273-ad85-11cd1263765d req-4fe77d7f-906a-4410-bd25-454a9c741423 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073215 Aug 31 09:51:15.551236 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 174/349] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:51:15.818954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:15.819667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:15.827980 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:15.828920 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:15.829373 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:15.830112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:15.831163 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:15.832271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:16.198209 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:16.199779 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:16.210460 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:16.210958 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:16.223920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:16.225051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:16.225531 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:16.225960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:16.232389 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:16.246256 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d541b3ee-7dbf-4ece-84af-a1904bd7ab27 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1699 microversion: 2.1 time: 0.430329 Aug 31 09:51:16.248076 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 176/350] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:15 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1699 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:16.279745 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5731522d-5a02-4abe-be69-4419fd53683b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:16.348715 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5731522d-5a02-4abe-be69-4419fd53683b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:16.349786 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5731522d-5a02-4abe-be69-4419fd53683b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:16.350259 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5731522d-5a02-4abe-be69-4419fd53683b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:16.489347 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:16.508615 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-34d9d9eb-b8ec-41a5-813b-c59ff5bf8868 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.314988 Aug 31 09:51:16.509207 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 175/351] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:16 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:16.512554 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5731522d-5a02-4abe-be69-4419fd53683b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Going to try to start instance {{(pid=132571) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 09:51:16.513932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:16.514548 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:16.538206 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:16.538724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:16.539403 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:16.540140 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:16.540605 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:16.541034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:16.616020 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5731522d-5a02-4abe-be69-4419fd53683b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/action" status: 202 len: 0 microversion: 2.1 time: 0.342816 Aug 31 09:51:16.616642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 177/352] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:51:16 2022] POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:51:16.625408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:16.626395 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:16.645043 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:16.651971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:16.654308 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:16.669291 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:16.670452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:16.671342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:16.919566 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:16.921672 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:16.943659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5160f915-c35b-4e60-b093-c46f92592df4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1371 microversion: 2.1 time: 0.432945 Aug 31 09:51:16.944096 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6480837e-b700-4274-a957-7207bca9e31f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1708 microversion: 2.1 time: 0.322196 Aug 31 09:51:16.945386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 178/353] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:16 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1708 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:16.964765 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 176/354] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:16 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:17.533069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:17.534750 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:17.559777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:17.560901 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:17.562838 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:17.564260 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:17.565116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:17.568512 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:17.845867 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:17.859930 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e254b2cf-e1de-410d-b975-c8bda8e61043 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.332592 Aug 31 09:51:17.861273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 179/355] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:17 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:17.991104 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:17.995698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:17.996026 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:17.997329 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:18.009477 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:18.010348 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:18.011101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:18.012627 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:18.015362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:18.016154 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:18.016730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:18.017262 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:18.021264 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:18.022704 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:18.023841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:18.024729 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:18.377254 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:18.383631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:18.397406 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-90e560ae-a9d1-4bab-bc1c-23ea7847acc7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1371 microversion: 2.1 time: 0.418551 Aug 31 09:51:18.398557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 177/356] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:17 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:18.886255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:18.887585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:18.901500 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:18.903262 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:18.905400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:18.907910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:18.910313 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:18.911764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:19.054739 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:19.097546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d58e8825-e8ed-44a1-ad08-f776280c40d2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1708 microversion: 2.1 time: 1.112392 Aug 31 09:51:19.105626 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 180/357] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:17 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1708 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:19.224898 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:19.255890 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-394ab6c3-26be-4493-9f99-c06b0eb6f75a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.371465 Aug 31 09:51:19.260633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 178/358] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:18 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:19.447024 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:19.454510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:19.477016 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:19.478636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:19.479915 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:19.482332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:19.482332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:19.483225 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:20.021398 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:20.031092 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a842acae-ad6c-46cb-a644-84448d943e65 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1371 microversion: 2.1 time: 0.598837 Aug 31 09:51:20.031888 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 181/359] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:19 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1371 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:20.130804 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:20.132226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:20.139991 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:20.140714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:20.141294 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:20.142245 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:20.143207 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:20.143602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:20.286390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:20.288831 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:20.311274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:20.312886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:20.314211 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:20.317031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:20.319746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:20.321731 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:20.456960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:20.473285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-df82dc36-2a35-4cfd-bc45-73c0e29b90b9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1708 microversion: 2.1 time: 0.348695 Aug 31 09:51:20.474531 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 179/360] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:20 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1708 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:20.708337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:20.721781 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e0102c74-d69e-454d-9974-fe0b4c0095cc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.441717 Aug 31 09:51:20.723236 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 182/361] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:20 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:21.001482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-4453f7bc-cc8d-417a-b1d5-555d30f45ddb req-20fdef60-907a-4ae4-b74b-a185abe6f6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ffd309-4ae6-48c6-ac5d-740538eee04a", "name": "network-vif-plugged", "status": "completed", "tag": "0527b895-2177-4cb0-9f5a-08f0343398af"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:21.026056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-4453f7bc-cc8d-417a-b1d5-555d30f45ddb req-20fdef60-907a-4ae4-b74b-a185abe6f6ae service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.026750 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-4453f7bc-cc8d-417a-b1d5-555d30f45ddb req-20fdef60-907a-4ae4-b74b-a185abe6f6ae service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.027349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-4453f7bc-cc8d-417a-b1d5-555d30f45ddb req-20fdef60-907a-4ae4-b74b-a185abe6f6ae service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.045185 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-4453f7bc-cc8d-417a-b1d5-555d30f45ddb req-20fdef60-907a-4ae4-b74b-a185abe6f6ae service nova] Creating event network-vif-plugged:0527b895-2177-4cb0-9f5a-08f0343398af for instance d2ffd309-4ae6-48c6-ac5d-740538eee04a on hv-cinder-83754 Aug 31 09:51:21.062586 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-4453f7bc-cc8d-417a-b1d5-555d30f45ddb req-20fdef60-907a-4ae4-b74b-a185abe6f6ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068206 Aug 31 09:51:21.067166 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 180/362] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:21.067538 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:21.068583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:21.085617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.086942 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.087972 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.090542 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.091730 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.092800 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.497804 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:21.509089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ad73d642-19e0-4201-bf8e-a3de126411f4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1371 microversion: 2.1 time: 0.454039 Aug 31 09:51:21.510344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:21.511263 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 183/363] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:21 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1371 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:21.511428 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:21.519489 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.520332 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.520768 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.521497 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.521940 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.522522 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.739770 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:21.745814 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:21.746703 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:21.764242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.765081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.765756 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.766709 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:21.767422 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:21.768306 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:21.769375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-797ced33-590d-4300-a810-8a493aa573e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1708 microversion: 2.1 time: 0.263537 Aug 31 09:51:21.770369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 181/364] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:21 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1708 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:21.982640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:22.001581 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-56b9c541-5610-42af-b9a6-e7eea5c1f939 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.259195 Aug 31 09:51:22.003769 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 184/365] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:21 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:22.556098 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:22.558871 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:22.569347 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:22.571233 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:22.572037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:22.573313 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:22.574116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:22.575320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:22.770057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:22.782970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-62c66a97-8b16-48a9-9489-81d81d5e7d30 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1371 microversion: 2.1 time: 0.246710 Aug 31 09:51:22.788748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 182/366] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:22 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:22.811552 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:22.812172 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:22.820423 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:22.820914 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:22.821353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:22.822083 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:22.822804 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:22.823271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:23.034630 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:23.036285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:23.050391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:23.050900 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:23.051373 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:23.052094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:23.052550 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:23.052973 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:23.060463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:23.080020 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7e083873-66d7-4018-8454-9bc62bd84b34 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1712 microversion: 2.1 time: 0.276073 Aug 31 09:51:23.081740 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 185/367] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:22 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1712 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:23.152320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-566a7adf-41bc-433f-b5d4-a53b235f1757 req-30f3e37d-0de6-4bee-abc6-5810fdeb2785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f44622-25b4-4470-85c3-bb4c09cbea6a", "name": "network-vif-plugged", "status": "completed", "tag": "193dcc74-523a-4cee-9f3e-460cdd4133e0"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:23.168277 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-566a7adf-41bc-433f-b5d4-a53b235f1757 req-30f3e37d-0de6-4bee-abc6-5810fdeb2785 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:23.171679 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-566a7adf-41bc-433f-b5d4-a53b235f1757 req-30f3e37d-0de6-4bee-abc6-5810fdeb2785 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:23.172341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-566a7adf-41bc-433f-b5d4-a53b235f1757 req-30f3e37d-0de6-4bee-abc6-5810fdeb2785 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:23.196617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-566a7adf-41bc-433f-b5d4-a53b235f1757 req-30f3e37d-0de6-4bee-abc6-5810fdeb2785 service nova] Creating event network-vif-plugged:193dcc74-523a-4cee-9f3e-460cdd4133e0 for instance 02f44622-25b4-4470-85c3-bb4c09cbea6a on hv-cinder-83754 Aug 31 09:51:23.209013 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-566a7adf-41bc-433f-b5d4-a53b235f1757 req-30f3e37d-0de6-4bee-abc6-5810fdeb2785 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057130 Aug 31 09:51:23.210169 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 186/368] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:51:23.290687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:23.304469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1c7b9f6d-d153-4543-aad3-4b7b24e0b8db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.277228 Aug 31 09:51:23.305228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 183/369] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:23 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:23.809672 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:23.810283 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:23.817724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:23.818511 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:23.818678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:23.819559 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:23.820028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:23.820464 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:23.998987 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:24.008634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c428e59d-5e57-4e06-ada6-1da51e55bd4b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1371 microversion: 2.1 time: 0.203907 Aug 31 09:51:24.009359 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 187/370] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:23 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:51:24.342237 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:24.343157 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:24.347030 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=18 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:24.357480 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:24.358371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:24.359101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:24.360389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:24.361204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:24.362639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:24.578590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:24.588689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-68b1cb99-e398-446e-81e3-5384027aa6f9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.254422 Aug 31 09:51:24.589590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 184/371] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:24 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:25.032888 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:25.034269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:25.041452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:25.041946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:25.042383 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:25.043104 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:25.043595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:25.044019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:25.198628 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:25.208661 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d1f06934-c68a-4789-91a3-cf7a1981836f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1565 microversion: 2.1 time: 0.179626 Aug 31 09:51:25.209260 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 188/372] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:25 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:25.246181 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-542fd3e8-aeff-4a75-8e4d-b27016f17e66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:25.246678 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-542fd3e8-aeff-4a75-8e4d-b27016f17e66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:25.254472 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-542fd3e8-aeff-4a75-8e4d-b27016f17e66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:25.254968 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-542fd3e8-aeff-4a75-8e4d-b27016f17e66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:25.255511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-542fd3e8-aeff-4a75-8e4d-b27016f17e66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:25.256171 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-542fd3e8-aeff-4a75-8e4d-b27016f17e66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:25.256632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-542fd3e8-aeff-4a75-8e4d-b27016f17e66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:25.257059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-542fd3e8-aeff-4a75-8e4d-b27016f17e66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:25.371867 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-542fd3e8-aeff-4a75-8e4d-b27016f17e66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129282 Aug 31 09:51:25.373017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 185/373] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 09:51:25 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:25.622530 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:25.623235 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:25.632198 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:25.632701 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:25.633140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:25.633874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:25.634321 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:25.634744 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:26.017226 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:26.029209 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-586f70c6-ec5b-47aa-a72f-bc7d3ec15f2c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1366 microversion: 2.1 time: 0.411129 Aug 31 09:51:26.029977 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 189/374] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:25 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1366 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:27.039760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-4b0dd8e7-a970-4b30-b345-5b7a6991b2ec req-38c68e80-0468-44a8-8c3a-de43890dec90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ffd309-4ae6-48c6-ac5d-740538eee04a", "tag": "0527b895-2177-4cb0-9f5a-08f0343398af"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:27.059512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-4b0dd8e7-a970-4b30-b345-5b7a6991b2ec req-38c68e80-0468-44a8-8c3a-de43890dec90 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:27.059512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-4b0dd8e7-a970-4b30-b345-5b7a6991b2ec req-38c68e80-0468-44a8-8c3a-de43890dec90 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:27.059512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-4b0dd8e7-a970-4b30-b345-5b7a6991b2ec req-38c68e80-0468-44a8-8c3a-de43890dec90 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:27.083299 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-4b0dd8e7-a970-4b30-b345-5b7a6991b2ec req-38c68e80-0468-44a8-8c3a-de43890dec90 service nova] Creating event network-changed:0527b895-2177-4cb0-9f5a-08f0343398af for instance d2ffd309-4ae6-48c6-ac5d-740538eee04a on hv-cinder-83754 Aug 31 09:51:27.087937 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:27.089386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:27.090057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-4b0dd8e7-a970-4b30-b345-5b7a6991b2ec req-38c68e80-0468-44a8-8c3a-de43890dec90 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056951 Aug 31 09:51:27.091561 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 186/375] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:51:27.101827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:27.105040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:27.106074 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:27.107588 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:27.108668 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:27.109640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:27.421945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:27.431793 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4876d4c7-c9d8-4179-b00f-69dc7f6f9e87 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1556 microversion: 2.1 time: 0.362250 Aug 31 09:51:27.432779 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 190/376] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:27 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1556 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:27.461196 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7aaf68ac-04c5-4346-9db5-4efbfb2b8238 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:27.462588 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7aaf68ac-04c5-4346-9db5-4efbfb2b8238 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:27.474471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7aaf68ac-04c5-4346-9db5-4efbfb2b8238 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:27.475857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7aaf68ac-04c5-4346-9db5-4efbfb2b8238 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:27.476645 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7aaf68ac-04c5-4346-9db5-4efbfb2b8238 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:27.477944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7aaf68ac-04c5-4346-9db5-4efbfb2b8238 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:27.478821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7aaf68ac-04c5-4346-9db5-4efbfb2b8238 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:27.479888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7aaf68ac-04c5-4346-9db5-4efbfb2b8238 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:27.625442 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7aaf68ac-04c5-4346-9db5-4efbfb2b8238 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172958 Aug 31 09:51:27.626422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 187/377] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 09:51:27 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:29.220886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-9ed60e60-5b21-4807-a3f2-efbfeec87640 req-de41def8-0858-4455-be26-a5270eab7067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02f44622-25b4-4470-85c3-bb4c09cbea6a", "tag": "193dcc74-523a-4cee-9f3e-460cdd4133e0"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:29.247772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-9ed60e60-5b21-4807-a3f2-efbfeec87640 req-de41def8-0858-4455-be26-a5270eab7067 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:29.248625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-9ed60e60-5b21-4807-a3f2-efbfeec87640 req-de41def8-0858-4455-be26-a5270eab7067 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:29.249390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-9ed60e60-5b21-4807-a3f2-efbfeec87640 req-de41def8-0858-4455-be26-a5270eab7067 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:29.272095 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-9ed60e60-5b21-4807-a3f2-efbfeec87640 req-de41def8-0858-4455-be26-a5270eab7067 service nova] Creating event network-changed:193dcc74-523a-4cee-9f3e-460cdd4133e0 for instance 02f44622-25b4-4470-85c3-bb4c09cbea6a on hv-cinder-83754 Aug 31 09:51:29.278248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-9ed60e60-5b21-4807-a3f2-efbfeec87640 req-de41def8-0858-4455-be26-a5270eab7067 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066938 Aug 31 09:51:29.279171 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 191/378] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:35.441723 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-15cd2e05-005a-4927-934b-90d74359ebc1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:35.442344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-15cd2e05-005a-4927-934b-90d74359ebc1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:35.444257 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:35.450453 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-15cd2e05-005a-4927-934b-90d74359ebc1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:35.450964 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-15cd2e05-005a-4927-934b-90d74359ebc1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:35.451412 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-15cd2e05-005a-4927-934b-90d74359ebc1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:35.452116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-15cd2e05-005a-4927-934b-90d74359ebc1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:35.452570 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-15cd2e05-005a-4927-934b-90d74359ebc1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:35.452993 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-15cd2e05-005a-4927-934b-90d74359ebc1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:35.480493 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-15cd2e05-005a-4927-934b-90d74359ebc1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/ips" status: 200 len: 151 microversion: 2.20 time: 0.044586 Aug 31 09:51:35.481100 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 188/379] 10.222.0.36 () {60 vars in 1289 bytes} [Wed Aug 31 09:51:35 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:51:37.313694 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1308129409", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-790377107", "security_groups": [{"name": "tempest-secgroup-smoke-817822166"}], "block_device_mapping_v2": [{"uuid": "3fe13405-4e50-4276-bae1-ea37fbb78f22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c93cbb45-31b4-4c55-8a58-3426eb15ee6e"}]}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:37.324382 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:37.444734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] validate_networks() for [('c93cbb45-31b4-4c55-8a58-3426eb15ee6e', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:51:37.840212 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:37.840773 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:37.848429 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:37.848929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:37.849365 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:37.850101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:37.850557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:37.850982 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:37.877221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lazy-loading 'flavor' on Instance uuid e2236114-93d1-4533-8199-e77b5996f54d {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:51:37.890044 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:51:37.890496 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:51:37.890932 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:51:37.891436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:51:37.891848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:51:37.902486 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:37.902968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:37.903433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:37.904166 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:37.904618 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:37.905042 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:37.915910 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:37.932422 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Getting quotas for project 9f1c2adbca494a53a24033b674c2762c. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:51:37.937759 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Getting quotas for user 893e06c5ea99497fae2847399b7a1a3c and project 9f1c2adbca494a53a24033b674c2762c. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:51:38.010090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:51:38.013631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fe13405-4e50-4276-bae1-ea37fbb78f22',volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:51:38.136776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-99ba5d18-3fe8-44cd-9550-6cb51fcf72bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/action" status: 202 len: 0 microversion: 2.20 time: 0.300464 Aug 31 09:51:38.137445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 189/380] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Aug 31 09:51:37 2022] POST /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:51:38.146646 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:38.147486 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:38.160574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:38.160574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:38.160574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:38.160574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:38.161315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:38.161315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:38.191374 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-75b648aa-57a7-4e45-b937-38c7bbfaab44 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.882044 Aug 31 09:51:38.202412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 192/381] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:51:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:51:38.218704 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a5d82ee7-46d5-49a2-a9ee-594b0b0fd321 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:38.220164 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a5d82ee7-46d5-49a2-a9ee-594b0b0fd321 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:38.312428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a5d82ee7-46d5-49a2-a9ee-594b0b0fd321 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:38.322912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a5d82ee7-46d5-49a2-a9ee-594b0b0fd321 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1094 microversion: 2.1 time: 0.113839 Aug 31 09:51:38.326701 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 193/382] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:38 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1094 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:38.388368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:38.398401 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:38.400023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:38.401313 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-863880b8-3255-4acc-a49d-e7de17a2c135 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.259200 Aug 31 09:51:38.402336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 190/383] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:38 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:51:39.344552 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:39.345210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:39.353194 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:39.353678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:39.354113 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:39.354816 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:39.355293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:39.355718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:39.427811 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:39.428217 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:39.430921 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:39.435800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:39.436447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:39.437085 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:39.438504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:39.439319 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:39.440048 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:39.445347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e4dc2b41-9188-4548-9f74-6383be3b9115 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1192 microversion: 2.1 time: 0.104450 Aug 31 09:51:39.446050 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 194/384] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:39 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:39.618372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:39.627835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:39.629377 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:39.630590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-10488aae-76a2-4b55-8f69-fb71120e670b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.208502 Aug 31 09:51:39.631432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 191/385] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:39 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:51:40.473943 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:40.474567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:40.485777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:40.485777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:40.485777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:40.485777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:40.486364 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:40.486364 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:40.572465 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:40.584030 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6df64f8d-1b26-4d0b-81a8-26c36c818b72 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1210 microversion: 2.1 time: 0.113956 Aug 31 09:51:40.585467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 195/386] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:40 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:40.658168 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:40.659255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:40.673396 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:40.673931 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:40.674372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:40.675111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:40.676157 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:40.676593 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:40.834073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:40.844514 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:40.846514 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:40.848595 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1aca3c76-2a4b-4b63-8388-3f96cbc6b78e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.197558 Aug 31 09:51:40.849935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 192/387] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:40 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:41.605275 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:41.605889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:41.612462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:41.613481 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:41.613893 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:41.614769 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:41.615259 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:41.615686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:41.839249 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:41.847015 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-aa76732e-e56e-452c-9741-09dd6e07e238 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.245542 Aug 31 09:51:41.848193 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 196/388] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:41 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:41.872499 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:41.873245 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:41.880595 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:41.881378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:41.881828 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:41.882539 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:41.882993 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:41.883464 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:42.028112 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:42.042318 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:42.043833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:42.045109 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-273f5a34-45fa-4a36-8c3c-a527572731f3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.176536 Aug 31 09:51:42.045686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 193/389] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:41 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:42.115994 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-4b88a80c-49de-4b87-a439-32e96adf6bef req-f675d9b5-b04b-41db-a0e7-7418f3aa8a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "468a13bb-2c16-4395-8ce5-afa5895c6111", "tag": "7cd12c4f-2837-4b86-8989-989cb73c2d2e"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:42.125929 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-4b88a80c-49de-4b87-a439-32e96adf6bef req-f675d9b5-b04b-41db-a0e7-7418f3aa8a09 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:42.126411 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-4b88a80c-49de-4b87-a439-32e96adf6bef req-f675d9b5-b04b-41db-a0e7-7418f3aa8a09 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:42.126839 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-4b88a80c-49de-4b87-a439-32e96adf6bef req-f675d9b5-b04b-41db-a0e7-7418f3aa8a09 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:42.138427 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-4b88a80c-49de-4b87-a439-32e96adf6bef req-f675d9b5-b04b-41db-a0e7-7418f3aa8a09 service nova] Creating event network-changed:7cd12c4f-2837-4b86-8989-989cb73c2d2e for instance 468a13bb-2c16-4395-8ce5-afa5895c6111 on hv-cinder-83754 Aug 31 09:51:42.144090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-4b88a80c-49de-4b87-a439-32e96adf6bef req-f675d9b5-b04b-41db-a0e7-7418f3aa8a09 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032828 Aug 31 09:51:42.145982 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 197/390] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:51:42.870527 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:42.871055 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:42.877764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:42.878351 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:42.878704 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:42.879429 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:42.879878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:42.880303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:43.023012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:43.025730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:43.033817 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6af1fd8a-db22-42ee-9385-6159634eb0e0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.167131 Aug 31 09:51:43.034422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 194/391] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:42 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:43.069861 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:43.070545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:43.076906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:43.077392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:43.077819 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:43.078513 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:43.079310 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:43.079423 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:43.310079 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:43.318901 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:43.320577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:43.321825 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e32e5006-a01f-4299-8522-481dcccd855d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.256971 Aug 31 09:51:43.322390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 198/392] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:43 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:44.054733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:44.055364 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:44.063096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:44.063630 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:44.064068 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:44.064767 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:44.065223 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:44.065650 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:44.208505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:44.216099 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5255b690-d304-4b35-a6fd-25753d46ed80 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.165326 Aug 31 09:51:44.216683 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 195/393] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:44 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:44.344536 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:44.345075 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:44.352201 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:44.352682 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:44.353118 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:44.353807 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:44.354271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:44.354700 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:44.492179 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:44.500522 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:44.501949 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:44.503082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ccd07c14-7035-4b8d-8998-bf8861982d70 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.162578 Aug 31 09:51:44.503710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 199/394] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:44 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:45.238365 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:45.239049 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:45.245873 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:45.246362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:45.246801 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:45.247526 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:45.247981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:45.248406 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:45.386164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:45.393748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0d2ad71b-3ff8-4536-9ee3-c28874e58cd8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.159795 Aug 31 09:51:45.394392 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 196/395] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:45 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:45.525604 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:45.526214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:45.532672 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:45.533157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:45.533592 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:45.534313 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:45.535351 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:45.535789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:45.667076 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:45.675106 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:45.677410 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:45.678567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f31b8e45-80f0-4980-9097-cfcaa0430f8a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.156866 Aug 31 09:51:45.679140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 200/396] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:45 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:51:46.414497 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:46.415099 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:46.422615 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:46.423113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:46.423590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:46.424305 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:46.424759 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:46.425185 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:46.563240 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:46.571837 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a3f3a18f-c239-48ea-8f07-d816fe3667fd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.161628 Aug 31 09:51:46.572438 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 197/397] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:46 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:46.701307 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:46.701908 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:46.708682 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:46.709203 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:46.709642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:46.710352 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:46.710806 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:46.711273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:46.865819 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:46.874351 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:46.876096 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:46.877292 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3d2ca176-3b9d-4ee7-93b7-972267028cdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.180122 Aug 31 09:51:46.877849 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 201/398] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:46 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:47.593303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:47.593849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:47.601619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:47.602098 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:47.602531 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:47.603258 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:47.603708 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:47.604129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:47.736294 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:47.744884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3b245bca-0ca3-4365-bc7d-d77b7faf90a8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.155665 Aug 31 09:51:47.745476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 198/399] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:47 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:47.902446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:47.902987 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:47.909449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:47.909993 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:47.910421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:47.911131 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:47.911591 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:47.912021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:47.916139 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:48.059318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:48.068256 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:48.069731 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:48.070921 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a631d796-110b-47cc-95b9-e1cedbd193d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.172936 Aug 31 09:51:48.071515 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 202/400] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:47 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:48.767823 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:48.768519 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:48.776481 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:48.776970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:48.777401 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:48.778250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:48.778796 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:48.779351 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:48.924431 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:48.933749 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-136ec06c-4d5b-4b6e-abe4-e70c1930f95e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.170363 Aug 31 09:51:48.934449 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 199/401] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:48 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:49.094720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:49.095324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:49.097853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=8 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:49.103717 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:49.104302 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:49.104686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:49.105470 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:49.105757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:49.106177 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:49.245751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:49.254685 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:49.256140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:49.257293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0a442250-63a1-4271-afd7-31bd7730963f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.166659 Aug 31 09:51:49.257847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 203/402] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:49 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:49.955412 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:49.956065 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:49.962948 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:49.963464 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:49.963906 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:49.964606 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:49.965065 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:49.965491 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:50.111894 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:50.120623 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-06b07d0c-7bd0-43d8-b23f-dc353b892bf4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.169023 Aug 31 09:51:50.121218 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 200/403] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:49 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:50.280906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:50.281450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:50.288767 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:50.289257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:50.289692 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:50.290389 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:50.290841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:50.291295 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:50.445802 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:50.454518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:50.456022 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:50.458006 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c1ae4ea0-9c09-43c0-891c-75b65df2e2fc tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.182069 Aug 31 09:51:50.458567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 204/404] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:50 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:51.141470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:51.142386 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:51.149781 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:51.150267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:51.150939 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:51.151678 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:51.152284 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:51.152770 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:51.325819 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:51.335242 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8b0559d2-ad0d-4c32-8be3-326b0d8e3f30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.197574 Aug 31 09:51:51.335825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 201/405] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:51 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:51.482698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:51.483344 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:51.490264 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:51.490781 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:51.491273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:51.491979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:51.492432 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:51.492855 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:51.627527 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:51.636361 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:51.637811 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:51.638969 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1aff5d55-d94b-4073-916f-c0693b7921a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.160985 Aug 31 09:51:51.639563 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 205/406] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:51 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:52.356967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:52.357581 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:52.365000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:52.365730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:52.366293 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:52.367380 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:52.367794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:52.368491 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:52.517021 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:52.525782 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-28f11d9f-133e-423a-83b6-3d91ceae6401 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.173151 Aug 31 09:51:52.526382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 202/407] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:52 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:52.671305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:52.671854 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:52.678662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:52.679149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:52.679581 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:52.680262 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:52.680710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:52.681124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:52.824475 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:52.833146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:52.834858 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:52.836073 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-29ba7d37-285d-4b33-9578-3e5bc074c827 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.168791 Aug 31 09:51:52.836663 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 206/408] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:52 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:53.193885 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-93688d9b-8e50-4fc6-b397-19b295768dbb req-40ee3fea-80f8-4183-b49f-aa417d658cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468a13bb-2c16-4395-8ce5-afa5895c6111", "name": "network-vif-plugged", "status": "completed", "tag": "7cd12c4f-2837-4b86-8989-989cb73c2d2e"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:53.204374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-93688d9b-8e50-4fc6-b397-19b295768dbb req-40ee3fea-80f8-4183-b49f-aa417d658cc2 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:53.204947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-93688d9b-8e50-4fc6-b397-19b295768dbb req-40ee3fea-80f8-4183-b49f-aa417d658cc2 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:53.205442 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-93688d9b-8e50-4fc6-b397-19b295768dbb req-40ee3fea-80f8-4183-b49f-aa417d658cc2 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:53.218760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-93688d9b-8e50-4fc6-b397-19b295768dbb req-40ee3fea-80f8-4183-b49f-aa417d658cc2 service nova] Creating event network-vif-plugged:7cd12c4f-2837-4b86-8989-989cb73c2d2e for instance 468a13bb-2c16-4395-8ce5-afa5895c6111 on hv-cinder-83754 Aug 31 09:51:53.225158 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-93688d9b-8e50-4fc6-b397-19b295768dbb req-40ee3fea-80f8-4183-b49f-aa417d658cc2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034448 Aug 31 09:51:53.225802 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 203/409] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:51:53.546251 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:53.546779 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:53.555963 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:53.556516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:53.556962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:53.557688 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:53.558278 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:53.558717 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:53.720738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:53.729236 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bdf1d699-83f0-4494-80c9-f7124f147dcd tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.187062 Aug 31 09:51:53.729808 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 207/410] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:53 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:53.860175 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:53.860892 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:53.867766 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:53.868280 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:53.868715 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:53.869404 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:53.869867 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:53.870344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:54.008320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:54.020964 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:54.022899 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:54.024133 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1adf9f9c-3bef-41ed-8252-e43197583fa9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.168967 Aug 31 09:51:54.024703 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 204/411] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:53 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:54.749655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:54.750519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:54.757806 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:54.758319 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:54.758745 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:54.759475 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:54.759925 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:54.760337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:54.918373 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:54.926707 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c60edbf4-ca0f-4e20-b6e9-e82ea5eade13 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1265 microversion: 2.1 time: 0.180377 Aug 31 09:51:54.927340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 208/412] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:54 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:55.047582 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:55.048192 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:55.055549 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:55.056038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:55.056479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:55.057192 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:55.057644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:55.058073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:55.199945 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:55.209601 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:55.211054 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:55.212241 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9da67a7d-3645-4ad5-adbe-730c39ca4614 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.168602 Aug 31 09:51:55.212817 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 205/413] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:55 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:55.954676 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:55.955311 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:55.962336 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:55.962820 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:55.963276 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:55.963967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:55.964420 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:55.964841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:56.105657 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:56.113518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f3fff87a-e2f1-4b73-9f01-49c8586d5883 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1452 microversion: 2.1 time: 0.162619 Aug 31 09:51:56.114836 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 209/414] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:55 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:56.134290 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:56.134987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:56.141442 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:56.141925 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:56.142353 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:56.143050 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:56.143521 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:56.143939 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:56.235810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:56.236388 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:56.243781 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:56.244279 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:56.244725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:56.245434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:56.245891 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:56.246317 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:56.285433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:56.294296 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-cd92213e-8cd2-4d70-b364-4c8b6bc15e96 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1452 microversion: 2.1 time: 0.163760 Aug 31 09:51:56.294903 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 206/415] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:51:56 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:51:56.403720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:56.412915 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:56.414370 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:56.415580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b0f8fc16-e413-4d35-a9bf-073e90450195 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.183813 Aug 31 09:51:56.416210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 210/416] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:56 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:51:57.438716 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:57.439363 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:57.446995 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:57.447533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:57.447972 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:57.448687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:57.449132 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:57.449553 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:57.926378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:57.935501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:57.936941 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:57.938097 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4ee998b9-59ff-41ef-be16-926816cfd281 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.503369 Aug 31 09:51:57.938662 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 207/417] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:57 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:51:58.651621 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-63d7197f-62ed-4074-820a-9374f5a1093b req-474301bd-799a-4600-a1a3-41053d462e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "468a13bb-2c16-4395-8ce5-afa5895c6111", "tag": "7cd12c4f-2837-4b86-8989-989cb73c2d2e"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:51:58.664991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-63d7197f-62ed-4074-820a-9374f5a1093b req-474301bd-799a-4600-a1a3-41053d462e1b service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:58.665760 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-63d7197f-62ed-4074-820a-9374f5a1093b req-474301bd-799a-4600-a1a3-41053d462e1b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:58.666470 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-63d7197f-62ed-4074-820a-9374f5a1093b req-474301bd-799a-4600-a1a3-41053d462e1b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:58.672679 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=100 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:58.682087 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-63d7197f-62ed-4074-820a-9374f5a1093b req-474301bd-799a-4600-a1a3-41053d462e1b service nova] Creating event network-changed:7cd12c4f-2837-4b86-8989-989cb73c2d2e for instance 468a13bb-2c16-4395-8ce5-afa5895c6111 on hv-cinder-83754 Aug 31 09:51:58.688232 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-63d7197f-62ed-4074-820a-9374f5a1093b req-474301bd-799a-4600-a1a3-41053d462e1b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040514 Aug 31 09:51:58.688752 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 211/418] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:51:58.966550 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:51:58.967164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:51:58.975445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:58.975928 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:58.976365 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:58.977273 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:51:58.977891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:51:58.978324 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:51:59.160045 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:59.177042 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:59.180469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:51:59.182868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-36e7a9c6-8315-4dbb-b0b3-3fff06d8c995 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.225292 Aug 31 09:51:59.183953 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 208/419] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:51:58 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:00.209022 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:00.209663 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:00.215940 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:00.216428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:00.216860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:00.217545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:00.217996 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:00.218652 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:00.367871 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:00.376500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:00.377939 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:00.379176 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ab19377b-35c4-4950-8849-b2fd8ebe88c4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1744 microversion: 2.20 time: 0.175640 Aug 31 09:52:00.380917 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 212/420] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:00 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:01.404104 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:01.404646 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:01.411622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:01.412109 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:01.412535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:01.413229 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:01.413666 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:01.414111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:01.560889 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:01.569533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:01.570957 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:01.572161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d07225bb-82e1-4b3f-9c85-20b15e7acb2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1744 microversion: 2.20 time: 0.172317 Aug 31 09:52:01.572720 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 209/421] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:01 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:02.595946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:02.596539 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:02.604878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:02.605373 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:02.605806 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:02.606508 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:02.606964 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:02.607433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:02.747773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:02.759214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:02.760689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:02.761852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6c561a3d-84c0-4ab5-adb9-19af95d81531 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1744 microversion: 2.20 time: 0.170008 Aug 31 09:52:02.762480 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 213/422] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:02 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:03.259106 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-be0ee362-b924-43df-b36b-81eb3c42da7f req-b0526715-990d-4edc-b862-42a0f4632f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2236114-93d1-4533-8199-e77b5996f54d", "name": "network-vif-plugged", "status": "completed", "tag": "3d1efd6d-0e8a-4b38-8680-3725504f96c6"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:03.275387 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-be0ee362-b924-43df-b36b-81eb3c42da7f req-b0526715-990d-4edc-b862-42a0f4632f21 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:03.275726 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-be0ee362-b924-43df-b36b-81eb3c42da7f req-b0526715-990d-4edc-b862-42a0f4632f21 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:03.276230 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-be0ee362-b924-43df-b36b-81eb3c42da7f req-b0526715-990d-4edc-b862-42a0f4632f21 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:03.294951 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-be0ee362-b924-43df-b36b-81eb3c42da7f req-b0526715-990d-4edc-b862-42a0f4632f21 service nova] Creating event network-vif-plugged:3d1efd6d-0e8a-4b38-8680-3725504f96c6 for instance e2236114-93d1-4533-8199-e77b5996f54d on hv-cinder-83754 Aug 31 09:52:03.302877 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-be0ee362-b924-43df-b36b-81eb3c42da7f req-b0526715-990d-4edc-b862-42a0f4632f21 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048286 Aug 31 09:52:03.303932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 210/423] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:03.788467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:03.789260 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:03.795617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:03.796439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:03.796972 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:03.797781 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:03.798407 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:03.798929 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:03.970874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:03.982100 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:03.983948 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:03.985146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5c2f101c-cba0-4a72-a6f6-8ae8c7fb63d8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1739 microversion: 2.20 time: 0.202977 Aug 31 09:52:03.986210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 214/424] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:03 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:05.027701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:05.027701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:05.056195 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:05.056976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:05.064584 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:05.065638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:05.067406 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:05.068327 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:05.259138 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:05.280270 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:05.282263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:05.283495 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-777300b3-7a8b-4626-9fbf-a9a452bfef75 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1739 microversion: 2.20 time: 0.273807 Aug 31 09:52:05.284359 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 211/425] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:05 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:06.310014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:06.310689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:06.318251 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:06.318736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:06.319193 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:06.319900 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:06.320351 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:06.320769 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:06.487544 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:06.496612 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:06.498056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:06.499322 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5a90e99d-e300-4358-a426-c7f9bf863a1f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1739 microversion: 2.20 time: 0.193143 Aug 31 09:52:06.506962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 215/426] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:06 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:07.522702 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:07.525991 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:07.529068 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=48 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:07.535930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:07.536590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:07.537158 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:07.538007 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:07.538492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:07.538968 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:07.702250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:07.704692 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:07.713440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:07.715038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:07.716237 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c3aa6c05-5186-44b7-a696-d34f75c24c7b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1739 microversion: 2.20 time: 0.198296 Aug 31 09:52:07.716812 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 212/427] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:07 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:08.742446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:08.743242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:08.745998 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:08.756394 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:08.756983 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:08.757513 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:08.758396 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:08.758854 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:08.759333 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:08.943768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:08.954758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:08.956277 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:08.958727 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1cfe959c-336b-4449-9451-71ae3ac97149 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1739 microversion: 2.20 time: 0.221309 Aug 31 09:52:08.959431 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 216/428] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:08 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:09.984162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:09.985442 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:09.995433 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:09.995923 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:09.996359 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:09.997276 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:09.997722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:09.998142 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:10.154808 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:10.164793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:10.166456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:10.168160 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-13f899fb-d268-475b-9603-27d181495b2c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1739 microversion: 2.20 time: 0.187744 Aug 31 09:52:10.169132 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 213/429] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:09 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:11.192476 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:11.193108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:11.200058 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:11.200551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:11.200991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:11.201706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:11.202166 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:11.202593 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:11.365610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:11.374336 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:11.376078 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:11.377237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a571ce95-4461-4b0a-ae83-29c9747d3972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1739 microversion: 2.20 time: 0.188795 Aug 31 09:52:11.383980 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 217/430] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:11 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:12.401107 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:12.401735 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:12.408186 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.408672 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.409106 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.409845 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:12.410812 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:12.411696 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:12.564372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:12.574639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:12.576133 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:12.577328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6d3511b4-3b22-4659-bb64-58d7d60b434a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1739 microversion: 2.20 time: 0.180088 Aug 31 09:52:12.577902 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 214/431] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:12 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:13.340291 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:13.340889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:13.346960 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.347557 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.348347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.348804 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.349263 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.349703 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.482067 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lazy-loading 'services' on Instance uuid 2795070d-ec5b-480c-91d5-f1317b74ea69 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:13.602794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:13.603670 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:13.607848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c14c1f56-aaf0-4b5d-bda5-bf3d42840fe2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/os-volume_attachments/1c912c92-8a95-474a-96a1-b9028441ba13" status: 202 len: 0 microversion: 2.1 time: 0.271565 Aug 31 09:52:13.608843 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 218/432] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:52:13 2022] DELETE /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/os-volume_attachments/1c912c92-8a95-474a-96a1-b9028441ba13 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:52:13.612177 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.612745 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.614202 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.615349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:13.616965 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:13.617616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:13.765039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:13.773663 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:13.775259 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:13.776429 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dc27adff-9732-4f55-966d-c43986d7c98f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1721 microversion: 2.20 time: 0.178558 Aug 31 09:52:13.777014 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 215/433] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:13 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:52:14.382192 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8687e048-075f-4758-8301-a80710ba2409 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7097c864-35ed-42e3-82fd-0fd51d7f9206"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:14.384829 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8687e048-075f-4758-8301-a80710ba2409 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:14.392168 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8687e048-075f-4758-8301-a80710ba2409 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.392655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8687e048-075f-4758-8301-a80710ba2409 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.393089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8687e048-075f-4758-8301-a80710ba2409 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.393784 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8687e048-075f-4758-8301-a80710ba2409 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.394256 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8687e048-075f-4758-8301-a80710ba2409 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.394939 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8687e048-075f-4758-8301-a80710ba2409 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.476589 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-07d00761-8c5f-43cf-94cc-bc759170a790 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:14.477261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-07d00761-8c5f-43cf-94cc-bc759170a790 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:14.483545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07d00761-8c5f-43cf-94cc-bc759170a790 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.484036 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07d00761-8c5f-43cf-94cc-bc759170a790 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.484470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07d00761-8c5f-43cf-94cc-bc759170a790 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.485178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07d00761-8c5f-43cf-94cc-bc759170a790 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.485629 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07d00761-8c5f-43cf-94cc-bc759170a790 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.486051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-07d00761-8c5f-43cf-94cc-bc759170a790 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.514969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-07d00761-8c5f-43cf-94cc-bc759170a790 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a/ips" status: 200 len: 149 microversion: 2.1 time: 0.042791 Aug 31 09:52:14.515708 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 216/434] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:52:14 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:52:14.531247 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee69d147-bc03-4f51-8abd-cfe154cc7184"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:14.533799 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:14.540303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.540805 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.541266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.541972 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.542422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.542843 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.637376 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Invalid volume: volume ee69d147-bc03-4f51-8abd-cfe154cc7184 is already attached to instances: c84e69de-d263-47c5-a190-3e39a8087f17 Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: POST /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a/os-volume_attachments HTTP/1.1 Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 74 Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:52:14.639039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {"volumeAttachment": {"volumeId": "ee69d147-bc03-4f51-8abd-cfe154cc7184"}} Aug 31 09:52:14.641680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Invalid volume: volume ee69d147-bc03-4f51-8abd-cfe154cc7184 is already attached to instances: c84e69de-d263-47c5-a190-3e39a8087f17 Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'server_id': '02f44622-25b4-4470-85c3-bb4c09cbea6a', 'body': {'volumeAttachment': {'volumeId': 'ee69d147-bc03-4f51-8abd-cfe154cc7184'}}} Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ee69d147-bc03-4f51-8abd-cfe154cc7184 is already attached to instances: c84e69de-d263-47c5-a190-3e39a8087f17 Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:14.643342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ee69d147-bc03-4f51-8abd-cfe154cc7184 is already attached to instances: c84e69de-d263-47c5-a190-3e39a8087f17 Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:14.646689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:14.649038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:14.649038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:52:14.649038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:52:14.649038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ee69d147-bc03-4f51-8abd-cfe154cc7184 is already attached to instances: c84e69de-d263-47c5-a190-3e39a8087f17 Aug 31 09:52:14.649038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:14.649038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 400 to user: Invalid volume: volume ee69d147-bc03-4f51-8abd-cfe154cc7184 is already attached to instances: c84e69de-d263-47c5-a190-3e39a8087f17 {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:52:14.649038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-521cc6dd-136a-4d1c-8fe0-389870487c76 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113511 Aug 31 09:52:14.649038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 217/435] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:52:14 2022] POST /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 09:52:14.652028 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:14.652562 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:14.659786 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.660425 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.660855 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.661555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.661996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.662437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.688900 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:52:14.776315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-cba08a41-429e-4fdc-be59-47b559fab37c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 204 len: 0 microversion: 2.1 time: 0.127858 Aug 31 09:52:14.776905 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 218/436] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:52:14 2022] DELETE /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:52:14.785462 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:14.786167 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:14.792250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.792735 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.793168 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.793911 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.794361 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.794783 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.932736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:14.940486 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5f5ea665-6d30-4489-aadc-bb210dac808d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1680 microversion: 2.1 time: 0.159112 Aug 31 09:52:14.941103 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 219/437] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:14 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:14.946252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:14.946848 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:14.952419 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.952901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.953334 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:14.954025 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:14.954476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:14.954897 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.095668 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:15.105021 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:15.106395 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:15.107646 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3ed3dd55-d19a-48ab-a6e7-583e5c7d92bf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1721 microversion: 2.20 time: 0.165040 Aug 31 09:52:15.108223 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 220/438] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:14 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:15.962777 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:15.963505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:15.971118 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.971633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.972074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:15.973429 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:15.973926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:15.974371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:16.119498 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:16.128163 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1b198395-a012-4625-b371-6e97c1f3090b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1680 microversion: 2.1 time: 0.169109 Aug 31 09:52:16.129295 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 221/439] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:15 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:16.134381 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:16.135078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:16.141631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:16.142141 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:16.142572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:16.143554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:16.145145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:16.145639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:16.302255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:16.310801 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:16.312254 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:16.313414 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9e12c739-b996-44ee-ac21-aecb8776ae8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1721 microversion: 2.20 time: 0.183207 Aug 31 09:52:16.313984 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 222/440] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:16 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:17.157631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:17.158316 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:17.165371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.165968 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.166397 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.167089 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.167559 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.167970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.312110 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:17.321569 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-580c9351-6d47-4e29-87d8-f5b0ee39b1e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1680 microversion: 2.1 time: 0.167797 Aug 31 09:52:17.322164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 223/441] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:17 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:17.326795 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-e4e907de-2e90-4ede-946c-7ec8a5a8ed90 req-94e74d8a-d9ff-4656-afed-b529177df5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2236114-93d1-4533-8199-e77b5996f54d", "name": "network-vif-unplugged", "status": "completed", "tag": "3d1efd6d-0e8a-4b38-8680-3725504f96c6"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:17.351810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-e4e907de-2e90-4ede-946c-7ec8a5a8ed90 req-94e74d8a-d9ff-4656-afed-b529177df5ec service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.352202 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-e4e907de-2e90-4ede-946c-7ec8a5a8ed90 req-94e74d8a-d9ff-4656-afed-b529177df5ec service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.352633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-e4e907de-2e90-4ede-946c-7ec8a5a8ed90 req-94e74d8a-d9ff-4656-afed-b529177df5ec service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.365791 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-e4e907de-2e90-4ede-946c-7ec8a5a8ed90 req-94e74d8a-d9ff-4656-afed-b529177df5ec service nova] Creating event network-vif-unplugged:3d1efd6d-0e8a-4b38-8680-3725504f96c6 for instance e2236114-93d1-4533-8199-e77b5996f54d on hv-cinder-83754 Aug 31 09:52:17.373255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-e4e907de-2e90-4ede-946c-7ec8a5a8ed90 req-94e74d8a-d9ff-4656-afed-b529177df5ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048877 Aug 31 09:52:17.374487 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 224/442] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:17.385215 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:17.386469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:17.398708 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.399632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.400416 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.401719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:17.402554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:17.403376 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:17.565541 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:17.578576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:17.578576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:17.578576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e89b094f-ee6a-4a5f-8c38-c5341d7b8d2a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1721 microversion: 2.20 time: 0.202033 Aug 31 09:52:17.580317 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 225/443] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:17 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:17.862180 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8687e048-075f-4758-8301-a80710ba2409 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.485780 Aug 31 09:52:17.869128 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 219/444] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:52:14 2022] POST /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments => generated 194 bytes in 3494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:18.344863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:18.345845 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:18.355391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.356044 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.356580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.357611 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.358275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.358802 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.531061 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:18.541272 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-85b047ba-a8c7-4aa5-98d1-63a9eedf7228 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1680 microversion: 2.1 time: 0.200627 Aug 31 09:52:18.543440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 226/445] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:18 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:18.607706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:18.609417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:18.620074 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.620792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.622181 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.623466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.623926 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.624565 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.880162 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:18.889722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:18.891721 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:18.892939 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-29c002bf-4aec-4c3b-b2fd-30ad8782f191 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1664 microversion: 2.20 time: 0.293209 Aug 31 09:52:18.893499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 220/446] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:18 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1664 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:18.919895 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7ed39a20-f407-4abf-81ab-effd25e3a4f6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0247248f-7cea-4d16-bfb2-d163706b7065"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:18.922569 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7ed39a20-f407-4abf-81ab-effd25e3a4f6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:18.929931 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ed39a20-f407-4abf-81ab-effd25e3a4f6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.930415 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ed39a20-f407-4abf-81ab-effd25e3a4f6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.930845 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ed39a20-f407-4abf-81ab-effd25e3a4f6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:18.931599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ed39a20-f407-4abf-81ab-effd25e3a4f6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:18.932237 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ed39a20-f407-4abf-81ab-effd25e3a4f6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:18.932700 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7ed39a20-f407-4abf-81ab-effd25e3a4f6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.151085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c1e8cf74-350a-49bd-baef-8851f45a7a92 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:19.170432 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1e8cf74-350a-49bd-baef-8851f45a7a92 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.171270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1e8cf74-350a-49bd-baef-8851f45a7a92 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.172002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c1e8cf74-350a-49bd-baef-8851f45a7a92 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.257430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c1e8cf74-350a-49bd-baef-8851f45a7a92 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Going to try to stop instance {{(pid=132571) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 09:52:19.356908 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:19.364637 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c1e8cf74-350a-49bd-baef-8851f45a7a92 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/action" status: 202 len: 0 microversion: 2.1 time: 0.220863 Aug 31 09:52:19.365824 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 221/447] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:52:19 2022] POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:52:19.376098 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-20417e59-89bf-4c9d-860c-d82f41188ba0 req-9a3ff411-29e0-4b86-ad02-47cc0f785b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02f44622-25b4-4470-85c3-bb4c09cbea6a", "name": "network-vif-deleted", "tag": "193dcc74-523a-4cee-9f3e-460cdd4133e0"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:19.390852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-20417e59-89bf-4c9d-860c-d82f41188ba0 req-9a3ff411-29e0-4b86-ad02-47cc0f785b34 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.391814 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-20417e59-89bf-4c9d-860c-d82f41188ba0 req-9a3ff411-29e0-4b86-ad02-47cc0f785b34 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.392710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-20417e59-89bf-4c9d-860c-d82f41188ba0 req-9a3ff411-29e0-4b86-ad02-47cc0f785b34 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.409601 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-20417e59-89bf-4c9d-860c-d82f41188ba0 req-9a3ff411-29e0-4b86-ad02-47cc0f785b34 service nova] Creating event network-vif-deleted:193dcc74-523a-4cee-9f3e-460cdd4133e0 for instance 02f44622-25b4-4470-85c3-bb4c09cbea6a on hv-cinder-83754 Aug 31 09:52:19.415240 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-20417e59-89bf-4c9d-860c-d82f41188ba0 req-9a3ff411-29e0-4b86-ad02-47cc0f785b34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047547 Aug 31 09:52:19.416889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 222/448] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:19.424735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:19.427317 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:19.437142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.437934 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.438544 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.439477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.440082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.440658 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.521372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7ed39a20-f407-4abf-81ab-effd25e3a4f6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.605663 Aug 31 09:52:19.523028 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 227/449] 10.222.0.36 () {62 vars in 1364 bytes} [Wed Aug 31 09:52:18 2022] POST /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments => generated 188 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:52:19.565883 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:19.567512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:19.577987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.578891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.579893 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.584096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.584794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.585478 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.620771 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:19.661345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6ebf0122-aac4-415f-99f9-e601894d83e2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.236806 Aug 31 09:52:19.663824 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 223/450] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:19 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:19.671846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.672369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.672814 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.673273 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lazy-loading 'fault' on Instance uuid 02f44622-25b4-4470-85c3-bb4c09cbea6a {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:19.750616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:19.751444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:19.752376 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:19.759165 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.759659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.760097 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.760805 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.761616 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.762208 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.767795 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e316ee8d-8291-4451-b474-9d4a8baf3e3f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 200 len: 1331 microversion: 2.1 time: 0.205997 Aug 31 09:52:19.775497 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 228/451] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:19 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 1331 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:19.819063 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132571) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 09:52:19.928873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6467f65a-185f-4eaf-9928-7a3e1b183dec tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/action" status: 202 len: 0 microversion: 2.20 time: 0.185142 Aug 31 09:52:19.934035 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 224/452] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Aug 31 09:52:19 2022] POST /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:52:19.939105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:19.939678 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:19.952113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.952622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.953065 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:19.953801 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:19.954262 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:19.954698 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.188988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:20.208566 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:20.210963 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:20.213353 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-bbf7438c-3365-49fe-a6c2-d7908027ce92 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1750 microversion: 2.20 time: 0.278374 Aug 31 09:52:20.230055 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 229/453] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:19 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1750 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:52:20.686854 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:20.688244 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:20.698577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.698577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.698577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.698577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.699013 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.699013 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.705976 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:20.805396 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:20.805812 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:20.827288 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.827790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.828241 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.828958 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:20.829414 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:20.829838 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:20.851322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a HTTP/1.1 Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:52:20.865878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:52:20.867475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': '02f44622-25b4-4470-85c3-bb4c09cbea6a'} Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:52:20.868328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:52:20.869724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:20.871015 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:20.872078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:52:20.873283 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5a236f6e-9074-42e1-a290-50520e73ef61 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 404 len: 111 microversion: 2.1 time: 0.073514 Aug 31 09:52:20.874391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 230/454] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:20 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:52:20.878539 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ed1b0037-cd10-40bf-93e4-eafef0eff7c4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.196392 Aug 31 09:52:20.880128 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 225/455] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:20 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:20.887415 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-bc61eff4-2c6b-47ef-9f4b-8a952e49faa3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '.version_select at 0x7f9462c22ee0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:20.917056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-bc61eff4-2c6b-47ef-9f4b-8a952e49faa3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011448916" status: 202 len: 0 microversion: 2.1 time: 0.036614 Aug 31 09:52:20.917628 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 231/456] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 09:52:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011448916 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:52:21.249248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:21.252636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:21.263594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.264578 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.265186 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.266416 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.267052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.268521 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.536540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:21.546029 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:21.547597 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:21.548989 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a7db16f6-f396-431f-a80a-6ee8ca43e30f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1750 microversion: 2.20 time: 0.304970 Aug 31 09:52:21.549562 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 226/457] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:21 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1750 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:21.908942 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:21.910776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:21.924342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.925009 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.926142 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.926376 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.927623 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.928203 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.975476 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:21.976150 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:21.986489 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.987089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.987773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:21.988900 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:21.989488 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:21.989931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.108239 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lazy-loading 'services' on Instance uuid c84e69de-d263-47c5-a190-3e39a8087f17 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:22.121733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:22.131426 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-90344730-2eef-47cb-be5a-0bd6b823e9e9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.226942 Aug 31 09:52:22.132681 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 232/458] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:21 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:22.211783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bd5ad96d-c5f4-4a09-8049-7efaea463e2a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments/ee69d147-bc03-4f51-8abd-cfe154cc7184" status: 202 len: 0 microversion: 2.1 time: 0.242885 Aug 31 09:52:22.212540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 227/459] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:52:21 2022] DELETE /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments/ee69d147-bc03-4f51-8abd-cfe154cc7184 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:52:22.222920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a908ba4c-b255-4130-b7fe-2cc99186a2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:22.225578 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a908ba4c-b255-4130-b7fe-2cc99186a2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:22.234452 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a908ba4c-b255-4130-b7fe-2cc99186a2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.235263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a908ba4c-b255-4130-b7fe-2cc99186a2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.236032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a908ba4c-b255-4130-b7fe-2cc99186a2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.237035 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a908ba4c-b255-4130-b7fe-2cc99186a2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.238572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a908ba4c-b255-4130-b7fe-2cc99186a2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.239563 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a908ba4c-b255-4130-b7fe-2cc99186a2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.276875 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a908ba4c-b255-4130-b7fe-2cc99186a2f6 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059078 Aug 31 09:52:22.278067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 233/460] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:22 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:22.573767 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:22.574500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:22.580789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.581291 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.581749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.582805 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:22.583304 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:22.583737 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:22.781406 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:22.792478 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:22.794103 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:22.795394 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-34233622-612d-447f-b161-3348f9b8f09c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1752 microversion: 2.20 time: 0.225886 Aug 31 09:52:22.796007 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 228/461] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:22 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1752 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:23.155418 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:23.156033 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:23.162801 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.163339 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.163775 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.164476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.164933 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.165396 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.291277 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ad11b101-e7c9-4e61-8b69-996f37d4efc4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:23.293525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ad11b101-e7c9-4e61-8b69-996f37d4efc4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:23.300945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad11b101-e7c9-4e61-8b69-996f37d4efc4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.301344 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad11b101-e7c9-4e61-8b69-996f37d4efc4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.301776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad11b101-e7c9-4e61-8b69-996f37d4efc4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.302497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad11b101-e7c9-4e61-8b69-996f37d4efc4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.302933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad11b101-e7c9-4e61-8b69-996f37d4efc4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.303390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad11b101-e7c9-4e61-8b69-996f37d4efc4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.312998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:23.321889 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-490b75ba-3974-485b-a4ca-34cce30e9fdf tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.170296 Aug 31 09:52:23.322476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 234/462] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:23 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:23.335970 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ad11b101-e7c9-4e61-8b69-996f37d4efc4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049067 Aug 31 09:52:23.336555 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 229/463] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:23 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:52:23.820484 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:23.821001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:23.826915 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.827434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.827873 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.828555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:23.829006 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:23.829432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:23.965588 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:23.976005 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:23.977565 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:23.978777 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9c92b359-d912-4795-98d4-02647bd6ce8c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1752 microversion: 2.20 time: 0.162253 Aug 31 09:52:23.979534 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 235/464] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:23 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:24.347960 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-00b1eae9-1299-407c-85d4-da9bf47923f0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:24.348514 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:24.348899 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:24.350595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-00b1eae9-1299-407c-85d4-da9bf47923f0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:24.355345 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:24.355839 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:24.356277 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:24.357043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:24.357427 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-00b1eae9-1299-407c-85d4-da9bf47923f0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:24.357604 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:24.357926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:24.358059 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-00b1eae9-1299-407c-85d4-da9bf47923f0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:24.358380 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-00b1eae9-1299-407c-85d4-da9bf47923f0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:24.359066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-00b1eae9-1299-407c-85d4-da9bf47923f0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:24.359536 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-00b1eae9-1299-407c-85d4-da9bf47923f0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:24.359954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-00b1eae9-1299-407c-85d4-da9bf47923f0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:24.390518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-00b1eae9-1299-407c-85d4-da9bf47923f0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046691 Aug 31 09:52:24.391086 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 230/465] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:24 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:24.495684 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:24.503865 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2a781c4c-a9d5-433f-9f20-2582330f3397 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.159681 Aug 31 09:52:24.504442 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 236/466] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:24 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:25.002243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:25.002860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:25.009536 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.010022 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.010457 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.011172 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.011640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.012064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.155271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:25.166665 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:25.169256 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:25.171100 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-36683e21-5454-4811-aa18-7134ebf5f65d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1752 microversion: 2.20 time: 0.173111 Aug 31 09:52:25.171820 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 231/467] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:24 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:25.406695 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-85c53594-a3a9-40ba-b667-16ed2b8b2d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:25.410279 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-85c53594-a3a9-40ba-b667-16ed2b8b2d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:25.418364 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85c53594-a3a9-40ba-b667-16ed2b8b2d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.418837 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85c53594-a3a9-40ba-b667-16ed2b8b2d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.419296 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85c53594-a3a9-40ba-b667-16ed2b8b2d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.419979 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85c53594-a3a9-40ba-b667-16ed2b8b2d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.420418 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85c53594-a3a9-40ba-b667-16ed2b8b2d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.420833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85c53594-a3a9-40ba-b667-16ed2b8b2d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.456416 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-85c53594-a3a9-40ba-b667-16ed2b8b2d40 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056513 Aug 31 09:52:25.458888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 237/468] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:25 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:25.525450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:25.526247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:25.534541 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.535778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.536318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.537378 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.538204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.538659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.682261 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:25.690086 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-35a491fc-707d-4a26-ad5d-7b6fa7c1afe1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.168684 Aug 31 09:52:25.690857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 232/469] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:25 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:25.793040 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:25.795635 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:25.803920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.804413 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.805009 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.805717 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.806193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.806654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.832992 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lazy-loading 'flavor' on Instance uuid d2ffd309-4ae6-48c6-ac5d-740538eee04a {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:25.962163 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-903161be-c975-4421-992d-d912de734ec1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/action" status: 200 len: 32 microversion: 2.1 time: 0.174689 Aug 31 09:52:25.962763 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 238/470] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:52:25 2022] POST /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:52:25.973879 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:25.975695 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:25.982761 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.983437 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.983828 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:25.984568 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:25.985090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:25.985696 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.167479 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:26.177298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-947592cf-6fc8-4166-b018-885b5035b468 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.208683 Aug 31 09:52:26.177887 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 233/471] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:25 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:26.198879 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:26.199505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:26.205624 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.206101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.206576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.207593 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.208035 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.208449 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.358889 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:26.370128 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:26.371795 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:26.373406 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d872710e-e8a5-4cc9-9b25-cd485946c14e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1752 microversion: 2.20 time: 0.178939 Aug 31 09:52:26.374689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 239/472] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:26 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:26.473950 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-65a1ba92-b177-4e73-8820-821d052931fa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:26.480269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-65a1ba92-b177-4e73-8820-821d052931fa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:26.489045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-65a1ba92-b177-4e73-8820-821d052931fa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.490020 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-65a1ba92-b177-4e73-8820-821d052931fa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.490821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-65a1ba92-b177-4e73-8820-821d052931fa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.492126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-65a1ba92-b177-4e73-8820-821d052931fa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.492936 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-65a1ba92-b177-4e73-8820-821d052931fa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.493710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-65a1ba92-b177-4e73-8820-821d052931fa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.535059 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-65a1ba92-b177-4e73-8820-821d052931fa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069149 Aug 31 09:52:26.535851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 234/473] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:26 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:26.712173 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:26.712718 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:26.719149 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.719641 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.720074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.720758 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:26.721200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:26.721613 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:26.867253 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:26.876363 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f02a7550-2b7a-4ae8-bd59-a1a6e57c80a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.168903 Aug 31 09:52:26.876969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 240/474] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:26 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:27.200403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:27.201324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:27.211690 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.212358 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.213031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.213778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.214384 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.214983 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.399700 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:27.400653 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:27.407821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.408545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.411631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.412374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.412840 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.413457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.461036 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:27.469535 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9b6cc8dc-1f96-4cab-893a-4080ca6959e8 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.273634 Aug 31 09:52:27.470212 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 235/475] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:27 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:27.548968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-96469738-7d8e-4f07-98c2-952dc84d24a5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:27.551816 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-96469738-7d8e-4f07-98c2-952dc84d24a5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:27.558414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96469738-7d8e-4f07-98c2-952dc84d24a5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.559199 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96469738-7d8e-4f07-98c2-952dc84d24a5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.559666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96469738-7d8e-4f07-98c2-952dc84d24a5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.560468 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96469738-7d8e-4f07-98c2-952dc84d24a5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.560930 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96469738-7d8e-4f07-98c2-952dc84d24a5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.561417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96469738-7d8e-4f07-98c2-952dc84d24a5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.586336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:27.593562 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-96469738-7d8e-4f07-98c2-952dc84d24a5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049514 Aug 31 09:52:27.594138 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 236/476] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:27 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:52:27.594873 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:27.596292 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:27.597546 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6463bb12-a300-49d4-8ca4-80be158b79d2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.203675 Aug 31 09:52:27.598100 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 241/477] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:27 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:52:27.898394 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:27.899215 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:27.905781 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.906272 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.906706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:27.907442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:27.907904 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:27.908336 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.078434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:28.086405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-08662651-b4f5-40c0-8fdc-93dbee87c85f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.191960 Aug 31 09:52:28.086979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 237/478] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:27 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:28.492438 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:28.493057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:28.500218 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.500706 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.501141 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.501844 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.502297 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.502718 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.506330 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:28.606776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1dd8ad36-ba48-4937-80a2-254888fa7a5d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:28.609450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1dd8ad36-ba48-4937-80a2-254888fa7a5d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:28.617663 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd8ad36-ba48-4937-80a2-254888fa7a5d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.618449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd8ad36-ba48-4937-80a2-254888fa7a5d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.619071 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd8ad36-ba48-4937-80a2-254888fa7a5d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.619984 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd8ad36-ba48-4937-80a2-254888fa7a5d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.620621 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd8ad36-ba48-4937-80a2-254888fa7a5d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.621052 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd8ad36-ba48-4937-80a2-254888fa7a5d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.652918 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1dd8ad36-ba48-4937-80a2-254888fa7a5d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050246 Aug 31 09:52:28.653476 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 238/479] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:52:28 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:52:28.657885 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:28.658482 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:28.665723 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.666221 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.666651 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.667386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.667837 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.668317 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.673906 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:28.683149 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0d322462-b882-493f-8732-99bd8e7121c5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.195187 Aug 31 09:52:28.683863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 242/480] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:28 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:28.728345 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:28.728957 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:28.734986 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.735572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.736073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.736824 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.737344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.739051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.768425 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:52:28.837493 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:28.852153 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:28.854158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:28.855952 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f1c323a0-4af8-4201-9f39-76c8172e10c0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.201569 Aug 31 09:52:28.856964 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 239/481] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:28 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:28.873600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-af4d8052-bc5a-4818-85f4-738e8d173c5a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 204 len: 0 microversion: 2.1 time: 0.148893 Aug 31 09:52:28.874188 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 243/482] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:52:28 2022] DELETE /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:52:28.882912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:28.883636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:28.889735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.890216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.890657 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:28.891387 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:28.891838 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:28.892260 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:29.073014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:29.084479 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-dc204c85-247d-4650-9084-b6580e79cb6f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.205741 Aug 31 09:52:29.085070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 240/483] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:28 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:29.110740 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:29.111825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:29.122932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:29.123451 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:29.124067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:29.125077 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:29.125514 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:29.126079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:29.291004 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:29.298862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1cf2143d-f9f2-4f1a-b6fb-6e99d0765198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.193638 Aug 31 09:52:29.299467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 244/484] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:29 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:29.705574 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:29.706264 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:29.712866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:29.713349 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:29.713782 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:29.714476 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:29.714935 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:29.715410 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:29.719735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:29.872235 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:29.882312 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8c882a76-5ed6-4dd6-9a70-f23c2a74a48b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.180006 Aug 31 09:52:29.883056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 241/485] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:29 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:29.886602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:29.887222 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:29.893884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:29.894978 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:29.895442 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:29.896135 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:29.896588 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:29.897007 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.056786 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:30.067535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:30.069106 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:30.070404 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-98e2c71d-c383-4c2f-b053-e3df9b7c1b40 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.190008 Aug 31 09:52:30.071010 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 245/486] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:29 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:30.106088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:30.106699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:30.113742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.114314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.114826 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.115646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.116115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.116551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.256155 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:30.266998 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-006176dd-7a4a-4353-9031-e4529d26fff9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.164515 Aug 31 09:52:30.267989 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 242/487] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:30 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:30.321279 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:30.321897 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:30.331052 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.331613 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.332050 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.332749 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.333198 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.333621 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.501669 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:30.511362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-61b5278d-4de6-417f-8190-58e0ce81f90a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.193706 Aug 31 09:52:30.512662 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 246/488] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:30 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:30.915085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:30.916863 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:30.928557 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.929140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.929642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:30.930448 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:30.931604 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:30.932354 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.093920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:31.095167 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:31.110485 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.111290 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.115103 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.115905 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.116376 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.116833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.146093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:31.155438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b883981b-ca11-48ac-8841-0e94fc434e92 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.249247 Aug 31 09:52:31.156152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 243/489] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:30 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:31.290832 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:31.291648 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:31.298537 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.299241 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.299777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.301477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.302065 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.302768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.323698 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:31.339600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:31.347495 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:31.348985 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-553781d2-46c3-4bec-9fb8-c4a1316d316d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.258829 Aug 31 09:52:31.358641 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 247/490] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:31 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:52:31.490796 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:31.499827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2c43445d-81f9-4780-bfb3-ecc7313943c9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.212465 Aug 31 09:52:31.500414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 244/491] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:31 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:31.535344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:31.536514 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:31.542491 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.542980 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.543538 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.544242 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:31.544699 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:31.545137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:31.716555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:31.726593 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ab211dd2-5172-4799-b7a8-8a58d0abb4c8 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.196100 Aug 31 09:52:31.727205 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 248/492] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:31 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:32.177469 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:32.178099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:32.184696 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.185172 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.185617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.186324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.186779 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.187245 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.344569 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:32.353119 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b1ad3dcd-2b10-4ab7-955b-66b5c930eb3d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.179351 Aug 31 09:52:32.353693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 245/493] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:32 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:32.398319 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:32.399654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:32.406040 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.406522 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.406939 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.407658 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.408102 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.408516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.538581 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:32.539487 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:32.549718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.551041 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.551610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.552418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.552951 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.553446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.567288 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:32.576399 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:32.578639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:32.579950 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-973434cb-d874-4d54-bc51-a248408c6021 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.186092 Aug 31 09:52:32.580599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 249/494] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:32 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:52:32.714082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:32.722688 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4e872557-d515-426d-b78c-0e29f0f2cef0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.189284 Aug 31 09:52:32.723296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 246/495] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:32 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:32.752440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:32.753494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:32.763187 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.763684 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.764121 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.764819 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:32.765265 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:32.765687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:32.917044 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:32.931746 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3a467411-1fc3-4279-a443-fcbb3de770a1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.185715 Aug 31 09:52:32.932935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 250/496] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:32 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:33.376924 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:33.377543 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:33.384127 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:33.384616 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:33.385057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:33.385756 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:33.386218 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:33.386649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:33.535135 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:33.543614 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-14d3f877-2c16-48a7-9d3a-17effbcd4c18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.171087 Aug 31 09:52:33.544315 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 247/497] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:33 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:33.603280 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:33.603914 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:33.610034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:33.610501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:33.610924 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:33.611653 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:33.612095 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:33.613034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:33.744866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:33.745514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:33.751866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:33.752870 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:33.752870 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:33.754253 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:33.754663 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:33.755082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:33.764231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:33.778026 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:33.780565 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:33.782832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4a572b21-e0a5-4400-9689-43033cf57561 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.183222 Aug 31 09:52:33.788378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 251/498] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:33 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:33.913072 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:33.920994 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b07843f1-adac-4e84-86c7-faecc2d9ec41 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.180076 Aug 31 09:52:33.921765 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 248/499] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:33 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:33.973783 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:33.974755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:33.984754 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:33.985566 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:33.986311 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:33.988268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:33.989101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:33.990079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.165093 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:34.176295 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-297ddfeb-18f3-4217-8abf-f114102dd4df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.210124 Aug 31 09:52:34.177446 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 252/500] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:33 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:34.566614 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:34.567413 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:34.573757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.574240 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.574675 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.575405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.575856 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.576310 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.736058 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:34.745071 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c297dd2f-ff02-4a36-8312-d40fd807dcba tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.183054 Aug 31 09:52:34.745664 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 249/501] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:34 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:34.809197 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:34.809822 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:34.819956 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.820389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.820945 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.821606 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.822064 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.822588 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.943789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:34.944702 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:34.951812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.952577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.953173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.954170 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:34.954781 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:34.955378 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:34.985849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:34.997214 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:34.998689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:35.000172 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4ab746e0-eac3-466d-bee2-59725c85a673 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.195221 Aug 31 09:52:35.000733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 253/502] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:34 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:35.119489 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:35.128941 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ded2afd4-5054-4679-9b37-f2baa56a3677 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.188927 Aug 31 09:52:35.137940 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 250/503] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:34 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:35.212522 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:35.213349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:35.215447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:35.221707 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.222424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.222978 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.223712 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.224179 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.224599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.383808 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:35.392324 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dc07ae60-a8a7-4025-84d5-ee08d9ee787e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.183526 Aug 31 09:52:35.393110 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 254/504] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:35 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:35.772400 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:35.773331 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:35.781130 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.781739 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.782402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.783245 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:35.783944 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:35.785455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:35.937069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:35.946390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a378f4b1-b4bd-4b0c-8163-1da22363af33 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.180014 Aug 31 09:52:35.947037 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 251/505] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:35 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:36.025919 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:36.026512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:36.033878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.034947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.035545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.036198 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.036787 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.037400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.151204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:36.151891 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:36.158274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.158795 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.159885 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.160705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.160991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.161430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.196587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:36.209774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:36.211765 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:36.213002 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c551fcfe-2700-4b7f-a0b0-26ee09a71972 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.191220 Aug 31 09:52:36.214974 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 255/506] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:36 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:36.327592 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:36.337880 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d86da648-7652-4401-bbd4-7b0ae097180a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.190578 Aug 31 09:52:36.338779 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 252/507] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:36 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:36.414448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:36.415238 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:36.421138 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.421612 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.422041 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.422765 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.423245 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.423668 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.589990 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:36.599659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5b6730ea-d9be-4085-a259-b480b29528e6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.189341 Aug 31 09:52:36.600494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 256/508] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:36 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:36.969224 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:36.969886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:36.978699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.979239 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.979675 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:36.980402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:36.980906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:36.981474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.228712 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:37.240036 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:37.241436 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:37.248858 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.249649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-239c43fd-5afd-4b41-a7b3-791be28a3e6c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.283694 Aug 31 09:52:37.250360 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.257238 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 253/509] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:36 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:37.258086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.259071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.259731 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.260337 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.263623 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:37.371633 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:37.372412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:37.380523 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.381019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.381498 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.382274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.382735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.383179 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.432388 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:37.448142 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:37.450330 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:37.452253 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-00e88031-2986-44e6-b791-23c587aa513b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.216861 Aug 31 09:52:37.453396 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 257/510] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:37 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:37.573257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:37.582306 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-07d1d1e5-1615-4284-8ab5-5124df01a787 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.217744 Aug 31 09:52:37.584007 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 254/511] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:37 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:37.622551 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:37.623720 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:37.631606 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.632488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.632987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.633812 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:37.634353 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:37.634844 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:37.790232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:37.801156 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-473e7b34-a5d9-4b3f-963c-a518c61ba310 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.181521 Aug 31 09:52:37.802178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 258/512] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:37 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:38.271743 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:38.272723 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:38.280274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.280953 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.281509 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.282363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.282946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.283518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.479226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:38.480279 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:38.491790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.492664 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.493534 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.494793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.496280 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.497272 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.499603 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:38.510362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a2d4472d-fd61-420e-9abe-13bb596085d1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.242468 Aug 31 09:52:38.525863 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 255/513] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:38 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:38.607060 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:38.607867 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:38.620120 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.622717 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.627494 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.629390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.629974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.630545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.689742 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:38.702187 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:38.703721 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:38.711267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-517549ff-2461-496e-afac-577f7adb32a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.238787 Aug 31 09:52:38.727648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 259/514] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:38 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:38.794881 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:38.803091 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ded4901d-983a-42cf-a80b-518c9710d290 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.200842 Aug 31 09:52:38.803703 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 256/515] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:38 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:38.824495 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:38.825111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:38.833052 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.833902 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.834344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.835078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:38.835701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:38.836151 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:38.987585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:38.995954 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-84485396-61b3-4e40-ae24-9cfc177c1da1 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1676 microversion: 2.1 time: 0.175688 Aug 31 09:52:38.996561 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 260/516] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:38 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:39.532614 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:39.533222 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:39.535591 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:39.541197 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.541684 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.542149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.542832 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.543312 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.543727 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.677192 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:39.679385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=100 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:39.686632 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-990d9918-0bb2-48ea-8237-a7d2794c3cb4 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.158045 Aug 31 09:52:39.687300 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 257/517] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:39 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:39.736766 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:39.737981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:39.744566 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.745053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.745486 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.746180 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.746637 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.747056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.825356 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:39.825974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:39.833929 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.834195 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.834633 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.835394 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:39.835854 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:39.836283 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:39.900422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:39.910179 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:39.911863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:39.913107 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-73eacef2-d4e5-4d9c-9153-7289e5f2d364 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.180290 Aug 31 09:52:39.914014 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 261/518] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:39 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:40.022901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:40.023613 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:40.025627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:40.029655 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.030139 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.030572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.031285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.031735 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.032149 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.033513 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-199b2553-1c0f-40fc-a3bd-88ed163bfa13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.212414 Aug 31 09:52:40.042669 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 258/519] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:39 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:40.167930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:40.176141 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-168a67f5-64e8-4236-a5e4-0b7a498e08e4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1653 microversion: 2.1 time: 0.158628 Aug 31 09:52:40.176755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 262/520] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:40 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1653 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:40.197581 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-80a55707-b153-4587-87f0-dd83236352a2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:40.203673 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-80a55707-b153-4587-87f0-dd83236352a2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.204158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-80a55707-b153-4587-87f0-dd83236352a2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.204594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-80a55707-b153-4587-87f0-dd83236352a2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.232285 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-80a55707-b153-4587-87f0-dd83236352a2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Going to try to start instance {{(pid=132571) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 09:52:40.290999 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-80a55707-b153-4587-87f0-dd83236352a2 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/action" status: 202 len: 0 microversion: 2.1 time: 0.097153 Aug 31 09:52:40.291638 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 259/521] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:52:40 2022] POST /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:52:40.300597 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:40.301698 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:40.308647 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.309130 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.309562 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.310250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.310698 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.311398 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.450729 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:40.459522 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7200f78e-10fc-4eba-8914-32c482f28198 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1662 microversion: 2.1 time: 0.163423 Aug 31 09:52:40.460105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 263/522] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:40 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:40.710269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:40.710980 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:40.718166 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.718734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.719267 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.719971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.720507 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.720853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.936447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:40.937050 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:40.944074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.944476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.944901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:40.945598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:40.946128 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:40.946624 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:41.096443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:41.106080 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:41.107560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:41.108960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-cae46bd7-1b79-4805-9ef5-0cf0d54e3a73 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.176207 Aug 31 09:52:41.109310 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 264/523] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:40 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:41.114314 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:41.114929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:41.121429 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:41.122604 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:41.122604 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:41.123105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:41.123502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:41.123926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:41.260581 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:41.269063 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c6f411b5-cb57-486f-9e7a-9d8060a97ca7 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1681 microversion: 2.1 time: 0.158211 Aug 31 09:52:41.269854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 265/524] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:41 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:41.335196 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:41.343365 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e4c3885e-0708-4b9f-b335-61655d3c2dbc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.637387 Aug 31 09:52:41.343947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 260/525] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:40 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:41.481263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:41.481790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:41.488959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:41.489461 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:41.489892 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:41.490637 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:41.491074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:41.491523 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:41.644205 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:41.652791 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4e3258ea-6e3d-4009-b759-321e986b09b3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1662 microversion: 2.1 time: 0.175508 Aug 31 09:52:41.653496 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 266/526] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:41 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1662 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:42.125665 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-24f91f9f-77df-4f28-9944-8ed316df5b3a req-92631f6f-02f7-43c7-bc83-a0caae3f05e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c84e69de-d263-47c5-a190-3e39a8087f17", "name": "network-vif-deleted", "tag": "f2a2ff95-6baf-4704-b5e9-844a4a2195ce"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:42.135770 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:42.136960 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-24f91f9f-77df-4f28-9944-8ed316df5b3a req-92631f6f-02f7-43c7-bc83-a0caae3f05e5 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.137451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-24f91f9f-77df-4f28-9944-8ed316df5b3a req-92631f6f-02f7-43c7-bc83-a0caae3f05e5 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.137649 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:42.137884 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-24f91f9f-77df-4f28-9944-8ed316df5b3a req-92631f6f-02f7-43c7-bc83-a0caae3f05e5 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.151947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-24f91f9f-77df-4f28-9944-8ed316df5b3a req-92631f6f-02f7-43c7-bc83-a0caae3f05e5 service nova] Creating event network-vif-deleted:f2a2ff95-6baf-4704-b5e9-844a4a2195ce for instance c84e69de-d263-47c5-a190-3e39a8087f17 on hv-cinder-83754 Aug 31 09:52:42.156800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.158198 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.158728 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.160265 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-24f91f9f-77df-4f28-9944-8ed316df5b3a req-92631f6f-02f7-43c7-bc83-a0caae3f05e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036936 Aug 31 09:52:42.160609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.160984 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.161415 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 261/527] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:42.162341 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.290993 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:42.291877 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:42.298525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.299202 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.300911 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.301630 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.302088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.303179 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.325350 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:42.337225 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:42.342285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:42.343491 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f21c5ef1-555e-448c-843f-0b81729b7a63 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.214141 Aug 31 09:52:42.344334 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 267/528] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:42 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:42.359747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.361170 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.362108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.363810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lazy-loading 'fault' on Instance uuid c84e69de-d263-47c5-a190-3e39a8087f17 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:42.366929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:42.367638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:42.376358 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.376840 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.377266 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.378138 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.378622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.379003 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.415398 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:42.424288 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-87858522-1cdb-4b27-bff6-bc7840147d48 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1331 microversion: 2.1 time: 0.137264 Aug 31 09:52:42.427057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 262/529] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:42 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1331 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:42.552274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:42.560971 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-13517c38-da7d-4174-982e-06a44fd2363b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.199145 Aug 31 09:52:42.561567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 268/530] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:42 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:42.674991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:42.675866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:42.681830 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.682353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.682759 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.683498 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:42.684002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:42.684434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:42.831626 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:42.839746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bd6ec14a-6410-4e06-b99d-dfa248d491b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1666 microversion: 2.1 time: 0.169097 Aug 31 09:52:42.840331 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 263/531] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:42 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1666 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:43.369027 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:43.369777 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:43.377298 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:43.378494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:43.378935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:43.379674 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:43.380134 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:43.380594 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:43.447451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:43.448217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:43.456946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:43.457801 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:43.458463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:43.459275 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:43.459736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:43.460296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:43.497270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:43.497752 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:43.498185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:43.498631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lazy-loading 'fault' on Instance uuid c84e69de-d263-47c5-a190-3e39a8087f17 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:52:43.533595 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:43.543489 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:43.545038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:43.545530 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:43.546412 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-58644d3f-6873-4d68-a50f-04061489bdcb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.181242 Aug 31 09:52:43.547107 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 269/532] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:43 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:43.554305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4cc773aa-9fd3-46ab-b380-b0f442f94eaa tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 200 len: 1331 microversion: 2.1 time: 0.110921 Aug 31 09:52:43.555066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 264/533] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:43 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:43.595500 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:43.596137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:43.603037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:43.603580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:43.604013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:43.604941 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:43.605608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:43.606033 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:43.754030 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:43.762362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fa22197d-7d41-4be7-8eee-58c3ff33432d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.181379 Aug 31 09:52:43.762948 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 270/534] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:43 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:44.570805 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:44.571770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:44.576539 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:44.577149 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:44.578221 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:44.578705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:44.579214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:44.579860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:44.580305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:44.580725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:44.585482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:44.586018 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:44.586465 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:44.587213 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:44.587679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:44.588104 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:44.604010 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 HTTP/1.1 Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:52:44.605738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:52:44.607096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'c84e69de-d263-47c5-a190-3e39a8087f17'} Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:52:44.607882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:52:44.609094 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:52:44.611161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:52:44.611161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c68eb92b-bf42-463d-8d66-649a7f7827d3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 404 len: 111 microversion: 2.1 time: 0.034817 Aug 31 09:52:44.611161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 271/535] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:44 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:52:44.616417 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ebaf3d47-23d7-4e14-a7aa-cff8e17108fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '.version_select at 0x7f9462a833a0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:44.638728 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ebaf3d47-23d7-4e14-a7aa-cff8e17108fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705010575" status: 202 len: 0 microversion: 2.1 time: 0.026174 Aug 31 09:52:44.639371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 272/536] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 09:52:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1705010575 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:52:44.731004 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:44.741175 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:44.742636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:44.744078 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-aa42aa7b-3a13-4fcb-8f14-91e9a9bf27f7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.177316 Aug 31 09:52:44.744808 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 265/537] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:44 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:44.786265 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:44.788501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:44.798929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:44.800143 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:44.800907 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:44.802176 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:44.802868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:44.803667 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:44.979954 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:44.987969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6e3bbefa-6568-464a-9df1-6a76590cc4bd tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.207065 Aug 31 09:52:44.988579 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 273/538] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:44 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:45.365920 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c85f0361-083e-4541-9223-c7538eee3d92 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: .version_select at 0x7f9462b308b0>, body: {"keypair": {"name": "tempest-keypair-1083125049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP/BBg1kvUVAZiYUFaa8R0Mo2rm9P1GN3kffPzc2V2xSKBYI1AsyMemnFVWa5R3YzoOJ6H1E4XTuBjJ+/8HNsg7wRDThuKAQihTVIEK1ZJbvgUPEBK0s9blUCEAbbPO/g=="}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:45.387475 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-c85f0361-083e-4541-9223-c7538eee3d92 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for project c4914faafb494e5bb323114853f25c54. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:52:45.391986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-c85f0361-083e-4541-9223-c7538eee3d92 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for user 980ab18eb5c646378d738079621a0dbc and project c4914faafb494e5bb323114853f25c54. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:52:45.417767 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c85f0361-083e-4541-9223-c7538eee3d92 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056787 Aug 31 09:52:45.418392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 266/539] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:52:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:45.767529 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:45.769372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:45.776516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:45.777012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:45.777469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:45.778210 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:45.778664 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:45.779156 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:45.976954 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:45.994705 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:45.997743 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:46.000312 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c59460b4-f3d8-4304-a474-fcc7677c06b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.236381 Aug 31 09:52:46.001581 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 274/540] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:45 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:46.018344 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:46.020504 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:46.031920 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:46.032791 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:46.033611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:46.035481 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:46.036325 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:46.037089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:46.308532 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:46.320775 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ba3aca1d-87e6-46dd-89ac-ae37614b43fb tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.309990 Aug 31 09:52:46.321393 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 267/541] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:46 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:47.036469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:47.036469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:47.044052 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:47.045125 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:47.045764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:47.046690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:47.047349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:47.047929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:47.080170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:47.220416 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:47.228555 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1131468570", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5fb2c2c-d2a5-4039-a42c-96d968ac091e"}], "security_groups": [{"name": "tempest-securitygroup--1811031636"}], "key_name": "tempest-keypair-1083125049", "user_data": "}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:47.229463 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:47.230919 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:47.232132 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-774d9e35-4030-4c0c-a312-9c5b4315f2ef tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.203012 Aug 31 09:52:47.232703 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 275/542] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:47 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:47.346143 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] validate_networks() for [('c5fb2c2c-d2a5-4039-a42c-96d968ac091e', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:52:47.348252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:47.349539 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:47.357478 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:47.358059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:47.358561 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:47.359961 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:47.359961 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:47.360199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:47.569351 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:47.578610 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-38fbb44b-68fd-4adc-b59a-5bfde55c0918 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.238588 Aug 31 09:52:47.592869 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 276/543] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:47 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:47.807516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:52:47.807944 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:52:47.808415 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:52:47.808824 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:52:47.809234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:52:47.820770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:47.821244 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:47.821668 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:47.822381 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:47.822824 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:47.823280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:47.841126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for project c4914faafb494e5bb323114853f25c54. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:52:47.845205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for user 980ab18eb5c646378d738079621a0dbc and project c4914faafb494e5bb323114853f25c54. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:52:47.857729 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:52:47.860004 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:52:47.909641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-493d863f-e994-4284-8323-e97ba1e530c1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.689919 Aug 31 09:52:47.910627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 268/544] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:52:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:52:47.921670 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a5975c3c-4aff-406e-b7e0-ccd36249c34e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:47.922290 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a5975c3c-4aff-406e-b7e0-ccd36249c34e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:47.983942 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a5975c3c-4aff-406e-b7e0-ccd36249c34e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:47.992037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a5975c3c-4aff-406e-b7e0-ccd36249c34e tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1242 microversion: 2.1 time: 0.074198 Aug 31 09:52:47.997987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 277/545] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:47 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:48.256654 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:48.257266 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:48.264006 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:48.264532 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:48.264929 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:48.265638 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:48.266089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:48.266520 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:48.447595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:48.457421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:48.458878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:48.460115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-502ade95-b0ba-4226-a12b-0deb0a5146f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.208286 Aug 31 09:52:48.460697 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 269/546] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:48 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:48.600766 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:48.601403 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:48.608315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:48.608886 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:48.609353 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:48.610137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:48.610853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:48.611496 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:48.758679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:48.767267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-32c5db4b-7ac1-43ff-badd-958d7ba92097 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.170676 Aug 31 09:52:48.767622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 278/547] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:48 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:49.012865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:49.013381 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:49.021277 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.021764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.022204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.022905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.023395 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.023825 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.091535 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:49.099740 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b0857419-f757-40ef-a2b8-ecade1513ece tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1294 microversion: 2.1 time: 0.090725 Aug 31 09:52:49.100328 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 270/548] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:49 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:49.485650 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:49.486262 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:49.492866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.493351 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.493788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.494495 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.494945 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.495418 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.561071 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-df558c7b-b870-4400-8fd7-9e9d1eeb808d req-19bd0bbe-bb6c-4331-9bab-79a320e9af37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2236114-93d1-4533-8199-e77b5996f54d", "name": "network-vif-plugged", "status": "completed", "tag": "3d1efd6d-0e8a-4b38-8680-3725504f96c6"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:49.593538 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-df558c7b-b870-4400-8fd7-9e9d1eeb808d req-19bd0bbe-bb6c-4331-9bab-79a320e9af37 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.594017 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-df558c7b-b870-4400-8fd7-9e9d1eeb808d req-19bd0bbe-bb6c-4331-9bab-79a320e9af37 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.594445 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-df558c7b-b870-4400-8fd7-9e9d1eeb808d req-19bd0bbe-bb6c-4331-9bab-79a320e9af37 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.606436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-df558c7b-b870-4400-8fd7-9e9d1eeb808d req-19bd0bbe-bb6c-4331-9bab-79a320e9af37 service nova] Creating event network-vif-plugged:3d1efd6d-0e8a-4b38-8680-3725504f96c6 for instance e2236114-93d1-4533-8199-e77b5996f54d on hv-cinder-83754 Aug 31 09:52:49.611613 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-df558c7b-b870-4400-8fd7-9e9d1eeb808d req-19bd0bbe-bb6c-4331-9bab-79a320e9af37 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054076 Aug 31 09:52:49.613353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 271/549] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:49.674091 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:49.685526 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:49.687634 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:49.689263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-481ce3f7-30b7-45d5-8e43-07c908d3139f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.207591 Aug 31 09:52:49.689866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 279/550] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:49 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:49.790811 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:49.791557 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:49.797883 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.798603 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.799367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:49.800746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:49.801403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:49.801831 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.056756 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:50.065583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d0cae3aa-f0bf-485f-b80b-ddd7defb9d2f tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.278916 Aug 31 09:52:50.066241 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 272/551] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:49 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:50.121158 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:50.121809 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:50.129797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.130563 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.130994 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.132443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.133124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.133743 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.318133 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:50.327145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-bae3d2cd-4521-4e9d-b27c-1063cfac3782 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.209903 Aug 31 09:52:50.327733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 280/552] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:50 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:50.713982 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:50.714587 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:50.721715 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.722103 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.722754 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.723513 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:50.723974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:50.724400 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:50.886062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:50.895056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:50.896533 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:50.897720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-df864ab8-24c7-4575-b0c2-4ab32bb83351 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.187704 Aug 31 09:52:50.898306 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 273/553] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:50 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:51.088596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:51.089210 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:51.095865 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.097299 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.097746 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.098452 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.098911 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.099378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.246148 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:51.256639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-610de511-22bf-40eb-9892-1dc9f779b913 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.172311 Aug 31 09:52:51.257274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 281/554] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:51 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:51.349005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:51.349623 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:51.356034 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.356519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.356948 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.357682 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.358211 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.358625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.640320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:51.648722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0a2753b9-d713-4144-a89f-7dc77a1457e2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.304480 Aug 31 09:52:51.649269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 274/555] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:51 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:51.920647 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:51.921154 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:51.928645 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.929137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.929568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.930275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.930724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.931365 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:51.977449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-562109c6-ec8f-4f53-837a-2ac8e445b30c req-79b01a0e-e99b-4249-9f31-0bc2f9edbd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b2cb47-9a46-450e-8bd9-f125d5aba697", "tag": "68efd6e2-678a-4fe0-bc21-3945918693d2"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:51.988799 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-562109c6-ec8f-4f53-837a-2ac8e445b30c req-79b01a0e-e99b-4249-9f31-0bc2f9edbd14 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:51.989281 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-562109c6-ec8f-4f53-837a-2ac8e445b30c req-79b01a0e-e99b-4249-9f31-0bc2f9edbd14 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:51.989771 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-562109c6-ec8f-4f53-837a-2ac8e445b30c req-79b01a0e-e99b-4249-9f31-0bc2f9edbd14 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.005139 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-562109c6-ec8f-4f53-837a-2ac8e445b30c req-79b01a0e-e99b-4249-9f31-0bc2f9edbd14 service nova] Creating event network-changed:68efd6e2-678a-4fe0-bc21-3945918693d2 for instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 on hv-cinder-83754 Aug 31 09:52:52.010141 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-562109c6-ec8f-4f53-837a-2ac8e445b30c req-79b01a0e-e99b-4249-9f31-0bc2f9edbd14 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038698 Aug 31 09:52:52.010753 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 275/556] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:52:52.091410 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:52.103472 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:52.104922 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:52.106099 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dd15009e-f443-4b2d-840a-ffd3219862d5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.189455 Aug 31 09:52:52.106665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 282/557] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:51 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:52:52.279477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:52.280311 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:52.287794 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.288289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.288757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.289458 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.289914 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.290340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.305245 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:52.427909 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:52.436064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c6395f14-f47d-47fb-a20f-64b064b27051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1736 microversion: 2.1 time: 0.160841 Aug 31 09:52:52.436635 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 276/558] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:52 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:52.669545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:52.670063 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:52.677544 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.685336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.685336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.685336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:52.685336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:52.685705 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:52.816222 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:52.824402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-09a8d45e-b5ec-4f3d-92c4-8055b50e69c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.158818 Aug 31 09:52:52.824969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 283/559] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:52 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:53.130045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.130656 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.137254 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.137741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.138179 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.138876 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.139366 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.139792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.272999 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:53.282111 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:53.284540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:53.285790 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ec75db53-0968-42cd-a49a-946e9d6914a2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.159650 Aug 31 09:52:53.286372 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 277/560] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:53 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:53.458594 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.459218 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.465575 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.466046 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.466473 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.467161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.467608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.468023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.609620 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:53.618376 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2a3b4ac5-8949-4835-9c92-bc1f79a6877d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1716 microversion: 2.1 time: 0.164444 Aug 31 09:52:53.618950 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 284/561] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:53 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1716 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:53.741817 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.742350 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.748290 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.748781 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.749482 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.750347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.750727 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.751173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.839788 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] HTTP exception thrown: Cannot 'detach_volume' instance d2ffd309-4ae6-48c6-ac5d-740538eee04a while it is in vm_state rescued Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Request method failure captured: Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: DELETE /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments/7097c864-35ed-42e3-82fd-0fd51d7f9206 HTTP/1.1 Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy5w7w6erjIccgUn-R2MYFy0wkKrnLBZ8G0LGzYBZIz-xcb-8Yn8UHnEdSssEMHV_zHLnUCz5n-M6ZjRm_k6YKV_oUnpLJFvOHsBqUCszrB3lOV_RHTzo8YIEsVmnEd7B9ET6Gqe4YcmIzrJ5bZ1232bHyDzwV1FphlF0D2Y1EIcJzk Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:52:53.841417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: b8818863a81b4238a22035fbb256568e Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:52:53.844418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Cannot 'detach_volume' instance d2ffd309-4ae6-48c6-ac5d-740538eee04a while it is in vm_state rescued Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'server_id': 'd2ffd309-4ae6-48c6-ac5d-740538eee04a', 'id': '7097c864-35ed-42e3-82fd-0fd51d7f9206'} Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d2ffd309-4ae6-48c6-ac5d-740538eee04a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:52:53.848280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d2ffd309-4ae6-48c6-ac5d-740538eee04a while it is in vm_state rescued Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d2ffd309-4ae6-48c6-ac5d-740538eee04a while it is in vm_state rescued Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:52:53.851334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Returning 409 to user: Cannot 'detach_volume' instance d2ffd309-4ae6-48c6-ac5d-740538eee04a while it is in vm_state rescued {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:52:53.854946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ac341617-528c-4ce3-8051-afe5cd46bee6 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments/7097c864-35ed-42e3-82fd-0fd51d7f9206" status: 409 len: 152 microversion: 2.1 time: 0.106075 Aug 31 09:52:53.854946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 278/562] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:52:53 2022] DELETE /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments/7097c864-35ed-42e3-82fd-0fd51d7f9206 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 09:52:53.855270 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.855270 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.856029 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4746907c-31df-40d8-86f7-b63b01c7212d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:53.856641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4746907c-31df-40d8-86f7-b63b01c7212d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.861382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.863468 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4746907c-31df-40d8-86f7-b63b01c7212d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.864125 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.864125 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.864437 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4746907c-31df-40d8-86f7-b63b01c7212d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.864605 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.864762 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4746907c-31df-40d8-86f7-b63b01c7212d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.865218 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.865720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4746907c-31df-40d8-86f7-b63b01c7212d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.866057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.866234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4746907c-31df-40d8-86f7-b63b01c7212d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.866651 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4746907c-31df-40d8-86f7-b63b01c7212d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.950490 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4746907c-31df-40d8-86f7-b63b01c7212d tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "POST /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/action" status: 202 len: 0 microversion: 2.1 time: 0.100277 Aug 31 09:52:53.951084 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 279/563] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:52:53 2022] POST /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:52:53.962322 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:53.963281 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:53.970014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.970610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.972008 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:53.972807 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:53.973281 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:53.973743 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:54.026462 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:54.036557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c8af72b8-7c92-4c39-8558-236aee74d157 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.193454 Aug 31 09:52:54.037231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 285/564] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:53 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:54.124217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:54.133780 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-30d259b5-017f-48c7-85f8-ce0c404c9025 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1724 microversion: 2.1 time: 0.176534 Aug 31 09:52:54.134531 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 280/565] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:53 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:52:54.309300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:54.309836 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:54.317220 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:54.317703 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:54.318136 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:54.318827 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:54.319305 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:54.319725 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:54.460771 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:54.471160 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:54.472587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:54.473829 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a6171835-2093-48f5-9b1e-c10ecdd4aad0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1808 microversion: 2.20 time: 0.168696 Aug 31 09:52:54.475444 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 286/566] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:54 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:55.057392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:55.058033 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:55.064627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.065617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.066046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.066970 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.067200 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.067622 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.156110 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:55.156756 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:55.163755 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.164235 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.164888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.165599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.166059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.166483 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.209770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.217579 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c8849994-5a47-42d5-932e-3d32020f0d12 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.163980 Aug 31 09:52:55.218170 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 281/567] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:55 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:55.305176 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.313393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-afbea4e4-bf8a-4c1e-a582-394a8d5c1b4e tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1724 microversion: 2.1 time: 0.161074 Aug 31 09:52:55.313893 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 287/568] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:55 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:55.498403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:55.499293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:55.506484 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.506974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.507446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.508140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:55.508596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:55.509021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:55.641782 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.651634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.653064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:55.654222 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-eab59058-2259-4b46-8c8a-592730039528 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1795 microversion: 2.20 time: 0.159740 Aug 31 09:52:55.654782 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 282/569] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:52:55 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:52:56.239642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:56.240437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:56.247713 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.248205 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.248632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.249609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.250053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.250472 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.338397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:56.339410 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:56.354363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.354900 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.355373 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.356096 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:56.356556 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:56.356984 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:56.404942 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:56.413652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-63ac2ac8-b869-48bb-b34c-b78fb2e87673 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.177955 Aug 31 09:52:56.414234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 288/570] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:56 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:56.574194 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:56.583542 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9fc2ee94-495e-4deb-b7d6-9d5bb2d12aa5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1724 microversion: 2.1 time: 0.249316 Aug 31 09:52:56.584061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 283/571] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:56 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:57.435185 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:57.435791 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:57.442910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.443529 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.443964 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:57.444664 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.445111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.445531 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:57.586923 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:57.594803 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a266f5f0-35aa-49d7-90a4-1faa52f01ef8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.163426 Aug 31 09:52:57.595409 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 289/572] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:57 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:57.614931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:57.615562 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:57.622104 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.622581 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.623005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:57.623746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:57.624457 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:57.624876 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:57.772829 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:57.781238 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b3e31419-af86-4241-abcd-7d606d89ce98 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1724 microversion: 2.1 time: 0.170822 Aug 31 09:52:57.781822 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 284/573] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:57 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:58.617879 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:58.619172 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:58.621143 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:58.627524 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.628013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.628438 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.629208 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.629653 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.630129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.776866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:58.784979 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a70b3ecb-9e55-4780-8159-a06bc0acebc1 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.171973 Aug 31 09:52:58.785730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 290/574] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:58 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:58.803112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:58.803751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:58.805772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:58.806436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=10 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:58.814982 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.815540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.815992 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.817923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.818449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.818890 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.960256 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:58.968460 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6bc3bff6-b5c5-4de7-a155-5bdb4e426cc3 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1730 microversion: 2.1 time: 0.169343 Aug 31 09:52:58.969022 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 285/575] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:58 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:52:58.990518 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-95c1683e-586d-440d-a8d6-871ff1d4b051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:58.990999 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-95c1683e-586d-440d-a8d6-871ff1d4b051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:58.996936 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-95c1683e-586d-440d-a8d6-871ff1d4b051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.997411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-95c1683e-586d-440d-a8d6-871ff1d4b051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.997838 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-95c1683e-586d-440d-a8d6-871ff1d4b051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:58.998517 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-95c1683e-586d-440d-a8d6-871ff1d4b051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:58.999300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-95c1683e-586d-440d-a8d6-871ff1d4b051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:58.999676 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-95c1683e-586d-440d-a8d6-871ff1d4b051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.083545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-95c1683e-586d-440d-a8d6-871ff1d4b051 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097396 Aug 31 09:52:59.084188 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 291/576] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 09:52:58 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:59.586039 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-96b29ceb-ce8b-461b-9add-a9a73b3aad4e req-4b35bf17-d477-4b12-9761-fcf34c23da13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b2cb47-9a46-450e-8bd9-f125d5aba697", "name": "network-vif-plugged", "status": "completed", "tag": "68efd6e2-678a-4fe0-bc21-3945918693d2"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:52:59.601108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-96b29ceb-ce8b-461b-9add-a9a73b3aad4e req-4b35bf17-d477-4b12-9761-fcf34c23da13 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:59.601856 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-96b29ceb-ce8b-461b-9add-a9a73b3aad4e req-4b35bf17-d477-4b12-9761-fcf34c23da13 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:59.602462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-96b29ceb-ce8b-461b-9add-a9a73b3aad4e req-4b35bf17-d477-4b12-9761-fcf34c23da13 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.614621 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-96b29ceb-ce8b-461b-9add-a9a73b3aad4e req-4b35bf17-d477-4b12-9761-fcf34c23da13 service nova] Creating event network-vif-plugged:68efd6e2-678a-4fe0-bc21-3945918693d2 for instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 on hv-cinder-83754 Aug 31 09:52:59.620544 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-96b29ceb-ce8b-461b-9add-a9a73b3aad4e req-4b35bf17-d477-4b12-9761-fcf34c23da13 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039295 Aug 31 09:52:59.621512 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 286/577] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:52:59.819741 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:52:59.820863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:52:59.827567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:59.828061 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:59.828493 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.829487 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:52:59.829960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:52:59.830355 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:52:59.971154 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:52:59.980274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-44ee4405-36b2-4eb8-abcf-e6bf5be77a14 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.170515 Aug 31 09:52:59.980969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 292/578] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:52:59 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:00.116265 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-3df5549c-3333-4112-bb24-49c67ba264b9 req-dfc5e38e-24c9-44b6-9ea3-37147c29bc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ffd309-4ae6-48c6-ac5d-740538eee04a", "tag": "0527b895-2177-4cb0-9f5a-08f0343398af"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:00.128056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-3df5549c-3333-4112-bb24-49c67ba264b9 req-dfc5e38e-24c9-44b6-9ea3-37147c29bc60 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:00.128540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-3df5549c-3333-4112-bb24-49c67ba264b9 req-dfc5e38e-24c9-44b6-9ea3-37147c29bc60 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:00.129051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-3df5549c-3333-4112-bb24-49c67ba264b9 req-dfc5e38e-24c9-44b6-9ea3-37147c29bc60 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:00.140267 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-3df5549c-3333-4112-bb24-49c67ba264b9 req-dfc5e38e-24c9-44b6-9ea3-37147c29bc60 service nova] Creating event network-changed:0527b895-2177-4cb0-9f5a-08f0343398af for instance d2ffd309-4ae6-48c6-ac5d-740538eee04a on hv-cinder-83754 Aug 31 09:53:00.145491 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-3df5549c-3333-4112-bb24-49c67ba264b9 req-dfc5e38e-24c9-44b6-9ea3-37147c29bc60 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034111 Aug 31 09:53:00.146088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 287/579] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:01.001420 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:01.002027 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:01.011228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:01.011717 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:01.012148 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:01.012859 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:01.013320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:01.013738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:01.030202 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:01.162717 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:01.170380 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-cdaea904-bc72-4d03-b7f0-b080e38f2dd8 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1368 microversion: 2.1 time: 0.173186 Aug 31 09:53:01.170960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 293/580] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:00 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:02.163979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-0fa7ea87-5d3c-4993-9edd-1e71a2cc4f83 req-fc8c61a8-49a0-42c3-b312-1283bc65c59b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ffd309-4ae6-48c6-ac5d-740538eee04a", "tag": "0527b895-2177-4cb0-9f5a-08f0343398af"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:02.173191 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-0fa7ea87-5d3c-4993-9edd-1e71a2cc4f83 req-fc8c61a8-49a0-42c3-b312-1283bc65c59b service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:02.173673 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-0fa7ea87-5d3c-4993-9edd-1e71a2cc4f83 req-fc8c61a8-49a0-42c3-b312-1283bc65c59b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:02.174105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-0fa7ea87-5d3c-4993-9edd-1e71a2cc4f83 req-fc8c61a8-49a0-42c3-b312-1283bc65c59b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:02.186451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-0fa7ea87-5d3c-4993-9edd-1e71a2cc4f83 req-fc8c61a8-49a0-42c3-b312-1283bc65c59b service nova] Creating event network-changed:0527b895-2177-4cb0-9f5a-08f0343398af for instance d2ffd309-4ae6-48c6-ac5d-740538eee04a on hv-cinder-83754 Aug 31 09:53:02.191689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:02.192481 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:02.192698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-0fa7ea87-5d3c-4993-9edd-1e71a2cc4f83 req-fc8c61a8-49a0-42c3-b312-1283bc65c59b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034070 Aug 31 09:53:02.193510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 288/581] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:53:02.198605 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:02.199093 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:02.199555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:02.200253 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:02.200708 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:02.201131 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:02.349113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:02.357002 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-27ac1af7-c798-469a-a82d-c20ba1360740 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1558 microversion: 2.1 time: 0.169270 Aug 31 09:53:02.357589 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 294/582] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:02 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:02.378245 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3fb309ca-a5a8-40f4-8ecd-31c20ca8c770 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:02.379393 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3fb309ca-a5a8-40f4-8ecd-31c20ca8c770 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:02.385766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3fb309ca-a5a8-40f4-8ecd-31c20ca8c770 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:02.386361 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3fb309ca-a5a8-40f4-8ecd-31c20ca8c770 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:02.386804 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3fb309ca-a5a8-40f4-8ecd-31c20ca8c770 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:02.387527 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3fb309ca-a5a8-40f4-8ecd-31c20ca8c770 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:02.387979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3fb309ca-a5a8-40f4-8ecd-31c20ca8c770 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:02.388430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3fb309ca-a5a8-40f4-8ecd-31c20ca8c770 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:02.497982 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3fb309ca-a5a8-40f4-8ecd-31c20ca8c770 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124258 Aug 31 09:53:02.498618 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 289/583] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 09:53:02 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:53:03.715263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-b335378d-acbf-41f1-89e8-9ba7dd8a73fe req-58255d37-3d3b-42b6-8875-a1852ef07a7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b2cb47-9a46-450e-8bd9-f125d5aba697", "tag": "68efd6e2-678a-4fe0-bc21-3945918693d2"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:03.725512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-b335378d-acbf-41f1-89e8-9ba7dd8a73fe req-58255d37-3d3b-42b6-8875-a1852ef07a7d service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:03.726081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-b335378d-acbf-41f1-89e8-9ba7dd8a73fe req-58255d37-3d3b-42b6-8875-a1852ef07a7d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:03.726646 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-b335378d-acbf-41f1-89e8-9ba7dd8a73fe req-58255d37-3d3b-42b6-8875-a1852ef07a7d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:03.739458 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-b335378d-acbf-41f1-89e8-9ba7dd8a73fe req-58255d37-3d3b-42b6-8875-a1852ef07a7d service nova] Creating event network-changed:68efd6e2-678a-4fe0-bc21-3945918693d2 for instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 on hv-cinder-83754 Aug 31 09:53:03.744639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-b335378d-acbf-41f1-89e8-9ba7dd8a73fe req-58255d37-3d3b-42b6-8875-a1852ef07a7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033062 Aug 31 09:53:03.745349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 295/584] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:22.284929 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:22.285673 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:22.290460 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-71dfb5e4-e865-45b1-975d-b7db3911d75a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:22.292608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-71dfb5e4-e865-45b1-975d-b7db3911d75a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:22.300382 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71dfb5e4-e865-45b1-975d-b7db3911d75a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:22.301055 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71dfb5e4-e865-45b1-975d-b7db3911d75a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:22.301677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71dfb5e4-e865-45b1-975d-b7db3911d75a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:22.302378 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71dfb5e4-e865-45b1-975d-b7db3911d75a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:22.302832 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71dfb5e4-e865-45b1-975d-b7db3911d75a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:22.303287 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-71dfb5e4-e865-45b1-975d-b7db3911d75a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:22.337655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-71dfb5e4-e865-45b1-975d-b7db3911d75a tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054457 Aug 31 09:53:22.338126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 290/585] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:22 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:53:22.404638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:22.405406 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=11 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:22.409547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:22.410152 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:22.417991 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:22.418475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:22.418908 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:22.419627 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:22.420081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:22.420503 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:22.446746 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:22.523456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fa70b13e-a945-43c7-be5f-709beeec785e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 204 len: 0 microversion: 2.1 time: 0.119244 Aug 31 09:53:22.524321 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 296/586] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:22 2022] DELETE /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:53:22.533073 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:22.533687 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:22.540352 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:22.540871 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:22.541276 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:22.541971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:22.542436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:22.542859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:22.731668 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:22.739567 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-801ea56d-21aa-4ebf-a5ad-56451448f34e tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1672 microversion: 2.1 time: 0.210346 Aug 31 09:53:22.740136 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 291/587] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:22 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:23.762173 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:23.762863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:23.769379 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:23.769947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:23.770381 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:23.771059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:23.771530 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:23.771943 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:23.961090 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:23.969112 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8e2ee115-0b9b-4243-959b-6ae76be5d00f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1672 microversion: 2.1 time: 0.211860 Aug 31 09:53:23.969687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 297/588] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:23 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1672 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:24.991976 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:24.992588 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:24.999165 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:24.999644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.000071 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.000751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:25.001197 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:25.001619 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:25.165039 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:25.172790 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3a23bd27-71df-456d-baef-4b9f99be04b4 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1672 microversion: 2.1 time: 0.185463 Aug 31 09:53:25.173370 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 292/589] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:24 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1672 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:26.195806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:26.196650 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:26.203515 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:26.203823 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:26.204248 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:26.204976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:26.205426 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:26.205846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:26.242268 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-bbe0bf75-a514-45d3-ad7a-5e8723359dee req-0e5c68ed-ec8d-4d8c-8998-7af537dcc5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2795070d-ec5b-480c-91d5-f1317b74ea69", "name": "network-vif-deleted", "tag": "a2b8c3ca-e7e6-4da8-a26d-11ed9ce5e3dc"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:26.258914 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-bbe0bf75-a514-45d3-ad7a-5e8723359dee req-0e5c68ed-ec8d-4d8c-8998-7af537dcc5f2 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:26.259628 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-bbe0bf75-a514-45d3-ad7a-5e8723359dee req-0e5c68ed-ec8d-4d8c-8998-7af537dcc5f2 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:26.260212 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-bbe0bf75-a514-45d3-ad7a-5e8723359dee req-0e5c68ed-ec8d-4d8c-8998-7af537dcc5f2 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:26.280137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-bbe0bf75-a514-45d3-ad7a-5e8723359dee req-0e5c68ed-ec8d-4d8c-8998-7af537dcc5f2 service nova] Creating event network-vif-deleted:a2b8c3ca-e7e6-4da8-a26d-11ed9ce5e3dc for instance 2795070d-ec5b-480c-91d5-f1317b74ea69 on hv-cinder-83754 Aug 31 09:53:26.285615 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-bbe0bf75-a514-45d3-ad7a-5e8723359dee req-0e5c68ed-ec8d-4d8c-8998-7af537dcc5f2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048081 Aug 31 09:53:26.287071 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 293/590] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:53:26.292733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:26.301831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-622233a3-82bc-4768-a8d3-0925e8eed922 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 200 len: 1604 microversion: 2.1 time: 0.111531 Aug 31 09:53:26.302436 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 298/591] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:26 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 1604 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:27.326762 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:27.327520 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:27.333958 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:27.335608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:27.335608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:27.336234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:27.336693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:27.337126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:27.353606 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] HTTP exception thrown: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Request method failure captured: Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 HTTP/1.1 Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy52w6wfH72f-sK25qErzAxt5rKNtYL1ccvYgQXOwyNK3IszxP6Ypgk7xGLyJfX63IJBEzMSARXZJ12Nqql2LpFy_MbWuF8-0XO3V5kJOAUUD9GGIIxHhKfCa62NMP_rKzUAmX_EZlGHRsbCJmcCF7lmt96i9_bByD0nlZ_h4y1vmsM Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:53:27.355510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: b6ca4276e1554d4184451313b2e09a88 Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:53:27.357789 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '2795070d-ec5b-480c-91d5-f1317b74ea69'} Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:27.359149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:53:27.361324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:27.362764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Returning 404 to user: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:27.362764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2840ebc0-0c6a-49b0-bef7-d81d28c06c01 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 404 len: 111 microversion: 2.1 time: 0.035128 Aug 31 09:53:27.362764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 294/592] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:27 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:53:27.367475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a3300d82-fcd2-4bb3-93c3-b473ea51c1c6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '.version_select at 0x7f9462ade280>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:27.388880 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a3300d82-fcd2-4bb3-93c3-b473ea51c1c6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163004813" status: 202 len: 0 microversion: 2.1 time: 0.026530 Aug 31 09:53:27.389575 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 299/593] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Aug 31 09:53:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163004813 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:53:28.107857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-cbc87dc3-5dbe-4c98-b501-079ef28eec36 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'create', calling method: .version_select at 0x7f9462970280>, body: {"keypair": {"name": "tempest-keypair-369977368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWvrv4L/XR/e4W8u2p4T8CskfqbvDTg17ndsTNuNc9GCBOQ5czi772pXTAqLU8AcumRpP5/cWpsIit7LaABEO9sjdy5RbUtdqKLxFCkPiwlbEP0TRW+bWV58pjgODriUQ=="}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:28.124407 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-cbc87dc3-5dbe-4c98-b501-079ef28eec36 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Getting quotas for project 568beb0822e640c1bacd98a2aec950ff. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:28.128273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-cbc87dc3-5dbe-4c98-b501-079ef28eec36 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Getting quotas for user b6ca4276e1554d4184451313b2e09a88 and project 568beb0822e640c1bacd98a2aec950ff. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:28.151812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-cbc87dc3-5dbe-4c98-b501-079ef28eec36 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047737 Aug 31 09:53:28.152421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 295/594] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:53:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:29.532692 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-258479362", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34569f52-bec4-4bad-9064-e6a8ffff260a"}], "security_groups": [{"name": "tempest-securitygroup--1316975593"}], "key_name": "tempest-keypair-369977368", "user_data": "}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:29.655206 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.network.neutron [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] validate_networks() for [('34569f52-bec4-4bad-9064-e6a8ffff260a', None, None, None, None, None)] {{(pid=132570) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:53:30.107069 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Flavor limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:53:30.107511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Image limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:53:30.107987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Flavor pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:53:30.108393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Image pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:53:30.108822 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:53:30.120129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:30.120714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:30.121144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:30.121866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:30.122320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:30.122767 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:30.141305 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Getting quotas for project 568beb0822e640c1bacd98a2aec950ff. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:30.145254 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Getting quotas for user b6ca4276e1554d4184451313b2e09a88 and project 568beb0822e640c1bacd98a2aec950ff. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:30.156743 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Going to run 1 instances... {{(pid=132570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:53:30.159073 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:53:30.207495 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-cd1a4e5a-c5d8-4a0f-bede-2a22639ea0a7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.682105 Aug 31 09:53:30.208147 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 300/595] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:53:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:53:30.220227 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-95f6f239-b07e-4032-9814-42b7f28450ba tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:30.220847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-95f6f239-b07e-4032-9814-42b7f28450ba tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:30.278370 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-95f6f239-b07e-4032-9814-42b7f28450ba tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:30.285462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-95f6f239-b07e-4032-9814-42b7f28450ba tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1236 microversion: 2.1 time: 0.069419 Aug 31 09:53:30.286010 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 296/596] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:30 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1236 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:31.307661 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:31.308232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:31.314432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:31.314922 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:31.315387 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:31.316086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:31.316541 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:31.317002 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:31.382558 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:31.390199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e4e8ad56-cd62-492b-8c10-df7c8aa92306 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1288 microversion: 2.1 time: 0.087024 Aug 31 09:53:31.390778 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 301/597] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:31 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:32.411732 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:32.412350 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:32.419749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:32.420244 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:32.420863 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:32.421757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:32.422216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:32.422650 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:32.665565 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:32.674186 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-60d5c77d-5169-447f-82c9-d737c4f207a0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1362 microversion: 2.1 time: 0.266198 Aug 31 09:53:32.674769 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 297/598] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:32 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:33.060316 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-1efd8428-ebbf-4bc2-b02a-1c9fe3cd4af5 req-ee9bf384-90ff-4ac7-a871-2d1b4d71019a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e870ae-a12e-4bd7-b49f-1bc976ea7bac", "tag": "65d7a932-46a5-495d-b669-205bbdc7fb8c"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:33.072585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-1efd8428-ebbf-4bc2-b02a-1c9fe3cd4af5 req-ee9bf384-90ff-4ac7-a871-2d1b4d71019a service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:33.073328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-1efd8428-ebbf-4bc2-b02a-1c9fe3cd4af5 req-ee9bf384-90ff-4ac7-a871-2d1b4d71019a service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:33.073892 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-1efd8428-ebbf-4bc2-b02a-1c9fe3cd4af5 req-ee9bf384-90ff-4ac7-a871-2d1b4d71019a service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:33.089810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-1efd8428-ebbf-4bc2-b02a-1c9fe3cd4af5 req-ee9bf384-90ff-4ac7-a871-2d1b4d71019a service nova] Creating event network-changed:65d7a932-46a5-495d-b669-205bbdc7fb8c for instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac on hv-cinder-83754 Aug 31 09:53:33.094905 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-1efd8428-ebbf-4bc2-b02a-1c9fe3cd4af5 req-ee9bf384-90ff-4ac7-a871-2d1b4d71019a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038522 Aug 31 09:53:33.095530 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 302/599] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:33.695308 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:33.695923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:33.702421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:33.702910 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:33.703370 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:33.704066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:33.704521 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:33.704950 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:33.835934 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:33.843849 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5387b91c-cf6a-4b0b-954e-a8b84e9b4b50 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1362 microversion: 2.1 time: 0.152509 Aug 31 09:53:33.844432 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 298/600] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:33 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:34.139004 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9ad59635-98bf-4fc5-8bc8-f95699c44053 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:34.139603 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9ad59635-98bf-4fc5-8bc8-f95699c44053 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:34.146079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ad59635-98bf-4fc5-8bc8-f95699c44053 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.146555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ad59635-98bf-4fc5-8bc8-f95699c44053 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.147733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ad59635-98bf-4fc5-8bc8-f95699c44053 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.148567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ad59635-98bf-4fc5-8bc8-f95699c44053 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.149020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ad59635-98bf-4fc5-8bc8-f95699c44053 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.149440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ad59635-98bf-4fc5-8bc8-f95699c44053 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.180631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9ad59635-98bf-4fc5-8bc8-f95699c44053 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments/0247248f-7cea-4d16-bfb2-d163706b7065" status: 200 len: 194 microversion: 2.20 time: 0.046034 Aug 31 09:53:34.181219 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 303/601] 10.222.0.36 () {60 vars in 1454 bytes} [Wed Aug 31 09:53:34 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments/0247248f-7cea-4d16-bfb2-d163706b7065 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:53:34.248923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:34.249415 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:34.255460 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.255949 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.256994 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.257881 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.258471 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.258891 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.344591 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lazy-loading 'services' on Instance uuid e2236114-93d1-4533-8199-e77b5996f54d {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:34.419524 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5d01be81-3971-40f6-99d9-8637ba787a25 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments/0247248f-7cea-4d16-bfb2-d163706b7065" status: 202 len: 0 microversion: 2.20 time: 0.174646 Aug 31 09:53:34.420122 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 299/602] 10.222.0.36 () {60 vars in 1457 bytes} [Wed Aug 31 09:53:34 2022] DELETE /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments/0247248f-7cea-4d16-bfb2-d163706b7065 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:53:34.428716 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-16fd7b4c-d443-4ac8-bb96-fdfcbf48531e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:34.431023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-16fd7b4c-d443-4ac8-bb96-fdfcbf48531e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:34.437174 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16fd7b4c-d443-4ac8-bb96-fdfcbf48531e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.437677 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16fd7b4c-d443-4ac8-bb96-fdfcbf48531e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.438101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16fd7b4c-d443-4ac8-bb96-fdfcbf48531e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.438795 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16fd7b4c-d443-4ac8-bb96-fdfcbf48531e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.439281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16fd7b4c-d443-4ac8-bb96-fdfcbf48531e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.439705 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16fd7b4c-d443-4ac8-bb96-fdfcbf48531e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.473021 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-16fd7b4c-d443-4ac8-bb96-fdfcbf48531e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048326 Aug 31 09:53:34.473586 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 304/603] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Aug 31 09:53:34 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:53:34.867343 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:34.868040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:34.874437 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.874915 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.875373 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:34.876065 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:34.876514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:34.876956 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:35.011776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:35.019440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-db7114d8-a5a7-494a-ae21-2c15b1b4dbb9 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1362 microversion: 2.1 time: 0.157223 Aug 31 09:53:35.020016 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 300/604] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:34 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:35.485368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c3085823-34b6-4e9a-b278-39494e023278 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:35.487513 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c3085823-34b6-4e9a-b278-39494e023278 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:35.494719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3085823-34b6-4e9a-b278-39494e023278 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:35.495247 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3085823-34b6-4e9a-b278-39494e023278 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:35.495680 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3085823-34b6-4e9a-b278-39494e023278 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:35.496375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3085823-34b6-4e9a-b278-39494e023278 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:35.496820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3085823-34b6-4e9a-b278-39494e023278 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:35.497243 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c3085823-34b6-4e9a-b278-39494e023278 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:35.531534 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c3085823-34b6-4e9a-b278-39494e023278 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050154 Aug 31 09:53:35.532117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 305/605] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Aug 31 09:53:35 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:53:36.040797 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:36.041419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:36.048015 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.048498 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.048926 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.049650 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.050116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.050518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.446859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:36.454588 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fb52a1a8-046c-4ecd-a557-b0d7bf4e0c39 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1362 microversion: 2.1 time: 0.418103 Aug 31 09:53:36.455176 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 301/606] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:36 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:36.544096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-179c5240-28ce-47f2-9f83-ab8ac7ee2d2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:36.546250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-179c5240-28ce-47f2-9f83-ab8ac7ee2d2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:36.552762 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-179c5240-28ce-47f2-9f83-ab8ac7ee2d2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.553337 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-179c5240-28ce-47f2-9f83-ab8ac7ee2d2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.553664 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-179c5240-28ce-47f2-9f83-ab8ac7ee2d2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.554346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-179c5240-28ce-47f2-9f83-ab8ac7ee2d2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.554800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-179c5240-28ce-47f2-9f83-ab8ac7ee2d2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.555251 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-179c5240-28ce-47f2-9f83-ab8ac7ee2d2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.585415 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-179c5240-28ce-47f2-9f83-ab8ac7ee2d2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044644 Aug 31 09:53:36.586421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 306/607] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Aug 31 09:53:36 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:36.648716 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:36.649137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:36.655109 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.655623 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.656061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.656783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.657236 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.657659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.682988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Going to try to terminate instance {{(pid=132571) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:36.762119 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-dce79c66-52f1-47b2-814f-c8b618cf372a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 204 len: 0 microversion: 2.20 time: 0.117688 Aug 31 09:53:36.762839 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 302/608] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Aug 31 09:53:36 2022] DELETE /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 09:53:36.771238 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:36.771935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:36.777867 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.778333 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.778769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.779483 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:36.779935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:36.780357 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:36.915705 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:36.923836 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:36.925271 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:36.926418 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-efcaf40c-d171-40ce-9d43-19fddd863473 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.159242 Aug 31 09:53:36.926978 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 307/609] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:36 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:37.477216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:37.477945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:37.484313 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:37.484787 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:37.485217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:37.485905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:37.486355 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:37.486773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:37.620467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:37.628693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ee1b70ba-0abb-4f24-b3dd-fe5b1835de55 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1362 microversion: 2.1 time: 0.156126 Aug 31 09:53:37.629293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 303/610] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:37 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:37.818903 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-c8d63463-0e8e-448f-98f3-3fd69dbdbf49 req-38350a9e-0ccc-4f87-93eb-92b6d8be348d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e870ae-a12e-4bd7-b49f-1bc976ea7bac", "name": "network-vif-plugged", "status": "completed", "tag": "65d7a932-46a5-495d-b669-205bbdc7fb8c"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:37.829117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-c8d63463-0e8e-448f-98f3-3fd69dbdbf49 req-38350a9e-0ccc-4f87-93eb-92b6d8be348d service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:37.829809 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-c8d63463-0e8e-448f-98f3-3fd69dbdbf49 req-38350a9e-0ccc-4f87-93eb-92b6d8be348d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:37.830631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-c8d63463-0e8e-448f-98f3-3fd69dbdbf49 req-38350a9e-0ccc-4f87-93eb-92b6d8be348d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:37.851440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-c8d63463-0e8e-448f-98f3-3fd69dbdbf49 req-38350a9e-0ccc-4f87-93eb-92b6d8be348d service nova] Creating event network-vif-plugged:65d7a932-46a5-495d-b669-205bbdc7fb8c for instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac on hv-cinder-83754 Aug 31 09:53:37.857164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-c8d63463-0e8e-448f-98f3-3fd69dbdbf49 req-38350a9e-0ccc-4f87-93eb-92b6d8be348d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041998 Aug 31 09:53:37.858040 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 308/611] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:37.950869 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:37.951512 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:37.957450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:37.957959 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:37.958587 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:37.959307 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:37.960368 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:37.960799 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:38.095871 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:38.104782 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:38.106232 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:38.107439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f3258aae-1e95-4001-93c2-d846259e4d59 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.160443 Aug 31 09:53:38.108002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 304/612] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:37 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:38.708364 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:38.709087 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:38.715818 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:38.716300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:38.716725 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:38.717416 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:38.718182 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:38.718281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:38.855803 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:38.863703 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b7ba22a1-2071-4854-85be-eea8d3bd5972 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1362 microversion: 2.1 time: 0.217539 Aug 31 09:53:38.864281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 309/613] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:38 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:39.133105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:39.134293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:39.144825 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.145322 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.145759 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.146579 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.147886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.148555 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.212497 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:39.212888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:39.218932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.219430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.219969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.220654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.221101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.221511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.355932 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:39.356547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lazy-loading 'services' on Instance uuid d2ffd309-4ae6-48c6-ac5d-740538eee04a {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:39.364905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:39.366861 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:39.368084 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-afbfef90-3b6b-4ad1-9748-d427c84d9fb1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1723 microversion: 2.20 time: 0.240353 Aug 31 09:53:39.368630 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 305/614] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:39 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:39.479300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-de34bff8-c7b6-4456-9a11-6f55afbc4069 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments/7097c864-35ed-42e3-82fd-0fd51d7f9206" status: 202 len: 0 microversion: 2.1 time: 0.271316 Aug 31 09:53:39.479970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 310/615] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:53:39 2022] DELETE /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments/7097c864-35ed-42e3-82fd-0fd51d7f9206 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:53:39.488325 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-68343c0e-4fc0-4d16-9178-35ffab34acc5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:39.490639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-68343c0e-4fc0-4d16-9178-35ffab34acc5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:39.496773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68343c0e-4fc0-4d16-9178-35ffab34acc5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.497264 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68343c0e-4fc0-4d16-9178-35ffab34acc5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.498505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68343c0e-4fc0-4d16-9178-35ffab34acc5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.498669 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68343c0e-4fc0-4d16-9178-35ffab34acc5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.499159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68343c0e-4fc0-4d16-9178-35ffab34acc5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.499580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68343c0e-4fc0-4d16-9178-35ffab34acc5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.530491 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-68343c0e-4fc0-4d16-9178-35ffab34acc5 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 Aug 31 09:53:39.531083 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 306/616] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:39 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:39.699664 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-e83f9b18-e839-4710-9256-11ae16c5e354 req-83e72bd8-a70f-4fb3-aae9-83d201202708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2236114-93d1-4533-8199-e77b5996f54d", "name": "network-vif-deleted", "tag": "3d1efd6d-0e8a-4b38-8680-3725504f96c6"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:39.710034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-e83f9b18-e839-4710-9256-11ae16c5e354 req-83e72bd8-a70f-4fb3-aae9-83d201202708 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.710551 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-e83f9b18-e839-4710-9256-11ae16c5e354 req-83e72bd8-a70f-4fb3-aae9-83d201202708 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.711214 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-e83f9b18-e839-4710-9256-11ae16c5e354 req-83e72bd8-a70f-4fb3-aae9-83d201202708 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.723463 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-e83f9b18-e839-4710-9256-11ae16c5e354 req-83e72bd8-a70f-4fb3-aae9-83d201202708 service nova] Creating event network-vif-deleted:3d1efd6d-0e8a-4b38-8680-3725504f96c6 for instance e2236114-93d1-4533-8199-e77b5996f54d on hv-cinder-83754 Aug 31 09:53:39.728679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-e83f9b18-e839-4710-9256-11ae16c5e354 req-83e72bd8-a70f-4fb3-aae9-83d201202708 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033185 Aug 31 09:53:39.729324 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 311/617] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:39.885816 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:39.886426 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:39.893313 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.894624 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.895362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.896566 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:39.897413 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:39.897770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:39.921409 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:40.048294 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:40.056593 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8ae121b6-aa90-4e52-ba57-54ba83d59623 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1362 microversion: 2.1 time: 0.175397 Aug 31 09:53:40.057173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 307/618] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:39 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:40.391471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:40.396946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=6 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:40.402473 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:40.403222 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:40.410548 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:40.411016 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:40.411480 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:40.412189 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:40.412845 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:40.413490 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:40.449499 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:40.449986 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:40.450619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:40.451065 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lazy-loading 'fault' on Instance uuid e2236114-93d1-4533-8199-e77b5996f54d {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:40.507412 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:40.515817 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:40.517359 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:40.518523 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1498158c-0c8e-4f99-99ab-83576aff8e1b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1371 microversion: 2.20 time: 0.128604 Aug 31 09:53:40.519469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 312/619] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:40 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:40.542979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bf82fdbb-76e1-4b89-9ffd-608dd83ef811 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:40.545404 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bf82fdbb-76e1-4b89-9ffd-608dd83ef811 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:40.547958 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=6 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:40.554312 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf82fdbb-76e1-4b89-9ffd-608dd83ef811 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:40.554799 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf82fdbb-76e1-4b89-9ffd-608dd83ef811 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:40.555408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf82fdbb-76e1-4b89-9ffd-608dd83ef811 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:40.556116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf82fdbb-76e1-4b89-9ffd-608dd83ef811 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:40.556584 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf82fdbb-76e1-4b89-9ffd-608dd83ef811 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:40.557048 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf82fdbb-76e1-4b89-9ffd-608dd83ef811 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:40.592054 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bf82fdbb-76e1-4b89-9ffd-608dd83ef811 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053304 Aug 31 09:53:40.592983 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 308/620] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:40 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:41.080508 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:41.081404 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:41.091023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.091499 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.092048 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.092821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.093143 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.093836 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.119314 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:41.246604 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:41.255843 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-699b05d0-a2f4-44d1-b4b9-1509b0da5ad3 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1546 microversion: 2.1 time: 0.181830 Aug 31 09:53:41.256748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 313/621] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:41 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:41.277676 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-33a21e05-e979-499b-84aa-5923f2490bf0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:41.278522 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-33a21e05-e979-499b-84aa-5923f2490bf0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:41.287218 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-33a21e05-e979-499b-84aa-5923f2490bf0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.288243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-33a21e05-e979-499b-84aa-5923f2490bf0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.288686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-33a21e05-e979-499b-84aa-5923f2490bf0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.289405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-33a21e05-e979-499b-84aa-5923f2490bf0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.289865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-33a21e05-e979-499b-84aa-5923f2490bf0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.290290 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-33a21e05-e979-499b-84aa-5923f2490bf0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.376298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-33a21e05-e979-499b-84aa-5923f2490bf0 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102073 Aug 31 09:53:41.377040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 309/622] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 09:53:41 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:41.544234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:41.545413 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:41.552427 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.553942 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.554501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.555376 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.555840 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.556270 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.592519 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.592915 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.593552 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.594162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lazy-loading 'fault' on Instance uuid e2236114-93d1-4533-8199-e77b5996f54d {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:41.606429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c87206c6-2e7c-4397-a2fd-b46f9856dfcc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:41.610242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c87206c6-2e7c-4397-a2fd-b46f9856dfcc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:41.616998 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c87206c6-2e7c-4397-a2fd-b46f9856dfcc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.617485 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c87206c6-2e7c-4397-a2fd-b46f9856dfcc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.617921 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c87206c6-2e7c-4397-a2fd-b46f9856dfcc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.618634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c87206c6-2e7c-4397-a2fd-b46f9856dfcc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:41.619659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c87206c6-2e7c-4397-a2fd-b46f9856dfcc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:41.619659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c87206c6-2e7c-4397-a2fd-b46f9856dfcc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:41.643609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:41.654973 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:41.656462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c87206c6-2e7c-4397-a2fd-b46f9856dfcc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055494 Aug 31 09:53:41.656624 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:41.661145 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 310/623] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:41 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:53:41.661327 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-13489e4f-6c03-48c0-8d68-4be533f32a2f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 200 len: 1371 microversion: 2.20 time: 0.120732 Aug 31 09:53:41.661327 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 314/624] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:41 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:42.459977 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-68201ac6-3790-4350-aa6a-eb2faef3bafa req-20523cd1-c0d7-46f4-8688-87fc1d08ab87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e870ae-a12e-4bd7-b49f-1bc976ea7bac", "tag": "65d7a932-46a5-495d-b669-205bbdc7fb8c"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:42.469576 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-68201ac6-3790-4350-aa6a-eb2faef3bafa req-20523cd1-c0d7-46f4-8688-87fc1d08ab87 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.470048 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-68201ac6-3790-4350-aa6a-eb2faef3bafa req-20523cd1-c0d7-46f4-8688-87fc1d08ab87 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.470474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-68201ac6-3790-4350-aa6a-eb2faef3bafa req-20523cd1-c0d7-46f4-8688-87fc1d08ab87 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.482028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-68201ac6-3790-4350-aa6a-eb2faef3bafa req-20523cd1-c0d7-46f4-8688-87fc1d08ab87 service nova] Creating event network-changed:65d7a932-46a5-495d-b669-205bbdc7fb8c for instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac on hv-cinder-83754 Aug 31 09:53:42.487153 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-68201ac6-3790-4350-aa6a-eb2faef3bafa req-20523cd1-c0d7-46f4-8688-87fc1d08ab87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031593 Aug 31 09:53:42.487754 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 311/625] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:42.670039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9c83de3e-fba3-4583-9782-140bdb7e3965 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:42.672447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9c83de3e-fba3-4583-9782-140bdb7e3965 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:42.680962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c83de3e-fba3-4583-9782-140bdb7e3965 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.681708 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c83de3e-fba3-4583-9782-140bdb7e3965 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.682357 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c83de3e-fba3-4583-9782-140bdb7e3965 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.682485 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:42.683736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c83de3e-fba3-4583-9782-140bdb7e3965 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.684079 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:42.684668 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c83de3e-fba3-4583-9782-140bdb7e3965 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.685288 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c83de3e-fba3-4583-9782-140bdb7e3965 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.692407 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.693203 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.694736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.695704 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.696560 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.697561 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.716905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] HTTP exception thrown: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Request method failure captured: Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d HTTP/1.1 Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy7Qq4mv9He1X6Syp6obkbBZ_BC3Qi-hWTnsEqDWAP9P57nB_U9Moz50gB3wPiPWDmZX15J1NO8wKWTKqk_WZDygLr6B-tlpQgX4EirgitkzndvdGAy11HgtNXAxbaIZ--RKy04MV58H6hhHL_lfIKZz_MXndlH4199Bk0CgHv14Q9A Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:53:42.719897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_40a8edca05bf4490948bb10b390bb373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 18eecdfed8cc44f685095b6a70a4e69d Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:53:42.721497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'e2236114-93d1-4533-8199-e77b5996f54d'} Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:42.722305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:53:42.723641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:42.724851 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9c83de3e-fba3-4583-9782-140bdb7e3965 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055773 Aug 31 09:53:42.726048 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Returning 404 to user: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:42.726980 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e0981c47-d17c-4ffa-9c29-bf99a7a3b44c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 404 len: 111 microversion: 2.20 time: 0.050207 Aug 31 09:53:42.728163 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 315/626] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:53:42 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:53:42.731154 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 312/627] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:42 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:53:42.739099 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1801ad1e-9f6b-4a0e-8dea-c82c4a7595b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '.version_select at 0x7f9462a83e50>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:42.762652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1801ad1e-9f6b-4a0e-8dea-c82c4a7595b4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368849715" status: 204 len: 0 microversion: 2.20 time: 0.028458 Aug 31 09:53:42.766736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 316/628] 10.222.0.36 () {60 vars in 1262 bytes} [Wed Aug 31 09:53:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368849715 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 09:53:42.823912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:42.824714 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:42.831173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.831895 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.832499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.833395 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:42.834006 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:42.835204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:42.872553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Going to try to terminate instance {{(pid=132571) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:42.986858 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0cfe596b-827d-4312-b457-cf210a8e306b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 204 len: 0 microversion: 2.1 time: 0.166429 Aug 31 09:53:42.994791 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 313/629] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:42 2022] DELETE /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:53:43.004072 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:43.004725 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:43.018164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.018908 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.019553 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.020453 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:43.021587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:43.023917 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:43.301870 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:43.313129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-191a3f6a-5f37-4470-a0a8-19bfb89546d2 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1690 microversion: 2.1 time: 0.313648 Aug 31 09:53:43.313722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 317/630] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:42 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1690 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:43.621010 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-af257223-7d07-4820-b10e-50153c80bd83 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'create', calling method: .version_select at 0x7f9462a00820>, body: {"keypair": {"name": "tempest-keypair-1084512676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9PP+kg3ottUMgC0J9FAc4aqWhyp2stzfejtg2H4OIcgvpNp0yOe2vKzGjdcPIXOREnnwiG7epvK9apnpagMb4lCVHoKWLDCKIve4VHgvAiAjW2sdveUnRe/yJLYxRCvw=="}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:43.638315 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-af257223-7d07-4820-b10e-50153c80bd83 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Getting quotas for project 40a8edca05bf4490948bb10b390bb373. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:43.642687 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-af257223-7d07-4820-b10e-50153c80bd83 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Getting quotas for user 18eecdfed8cc44f685095b6a70a4e69d and project 40a8edca05bf4490948bb10b390bb373. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:43.669996 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-af257223-7d07-4820-b10e-50153c80bd83 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053778 Aug 31 09:53:43.670608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 314/631] 10.222.0.36 () {62 vars in 1200 bytes} [Wed Aug 31 09:53:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 09:53:44.333954 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:44.335043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:44.341658 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:44.342142 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:44.342568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:44.343318 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:44.343764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:44.344260 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:44.564034 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:44.572604 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fc81e3c4-ad67-464d-8c44-235d059a9960 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1690 microversion: 2.1 time: 0.242576 Aug 31 09:53:44.573598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 318/632] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:44 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:45.171677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-434053643", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4ce22a7-9418-45fc-a1e0-ce7146d1a645"}], "security_groups": [{"name": "tempest-securitygroup--987334146"}], "key_name": "tempest-keypair-1084512676", "user_data": "}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:45.276596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] validate_networks() for [('b4ce22a7-9418-45fc-a1e0-ce7146d1a645', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:53:45.594461 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:45.595071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:45.602245 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:45.602734 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:45.603220 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:45.603916 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:45.604372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:45.604797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:45.707811 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:53:45.708310 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:53:45.709480 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:53:45.710059 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:53:45.710614 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:53:45.719639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:45.720198 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:45.720696 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:45.721479 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:45.721928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:45.722341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:45.741675 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Getting quotas for project 40a8edca05bf4490948bb10b390bb373. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:53:45.742865 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:45.746013 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Getting quotas for user 18eecdfed8cc44f685095b6a70a4e69d and project 40a8edca05bf4490948bb10b390bb373. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:53:45.751570 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3df890a8-8be9-449c-8311-20b3466bdfbf tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1690 microversion: 2.1 time: 0.161461 Aug 31 09:53:45.752158 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 319/633] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:45 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:45.758123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:53:45.760689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:53:45.772880 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:45.808037 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-da2824ee-3dec-48e5-bb4c-b9235fbe0c68 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.641172 Aug 31 09:53:45.808667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 315/634] 10.222.0.36 () {62 vars in 1188 bytes} [Wed Aug 31 09:53:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 09:53:45.819619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-142bbba4-e832-41b9-afef-8a1c6c1c3dad tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:45.820308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-142bbba4-e832-41b9-afef-8a1c6c1c3dad tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:45.875848 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-142bbba4-e832-41b9-afef-8a1c6c1c3dad tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:45.883569 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-142bbba4-e832-41b9-afef-8a1c6c1c3dad tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:45.885164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-142bbba4-e832-41b9-afef-8a1c6c1c3dad tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:45.886237 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-142bbba4-e832-41b9-afef-8a1c6c1c3dad tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1281 microversion: 2.20 time: 0.070618 Aug 31 09:53:45.886783 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 320/635] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:45 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:46.777572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:46.777572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:46.783297 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.783727 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.784166 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.784875 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.785332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.785759 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.908991 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:46.910076 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:46.917636 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.918129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.918559 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.919299 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:46.919736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:46.920191 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:46.991151 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:47.000390 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:47.001958 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:47.003074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f1b6e715-a3c0-44cf-91cd-fda380be4142 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1333 microversion: 2.20 time: 0.098577 Aug 31 09:53:47.013225 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 321/636] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:46 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:47.051249 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:47.063541 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bb824465-cc47-41c8-af6e-996e97bc5a19 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1690 microversion: 2.1 time: 0.292059 Aug 31 09:53:47.064258 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 316/637] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:46 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1690 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:48.026491 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:48.027440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:48.034090 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.034998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.035636 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.036508 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.037853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.038437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.130271 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:48.139531 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0b41fedb-e77f-45d8-9682-5e545efa5335 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:48.140457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:48.140971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0b41fedb-e77f-45d8-9682-5e545efa5335 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:48.142086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:48.143479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b2e5398c-d77d-4b70-a9fc-a6b9602cf27c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1339 microversion: 2.20 time: 0.121600 Aug 31 09:53:48.155961 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 322/638] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:48 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:48.163729 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b41fedb-e77f-45d8-9682-5e545efa5335 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.164517 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b41fedb-e77f-45d8-9682-5e545efa5335 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.165069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b41fedb-e77f-45d8-9682-5e545efa5335 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.165862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b41fedb-e77f-45d8-9682-5e545efa5335 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.166396 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b41fedb-e77f-45d8-9682-5e545efa5335 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.166898 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0b41fedb-e77f-45d8-9682-5e545efa5335 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.168910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:48.169901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:48.178719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.179758 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.180435 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.181665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.182567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.183401 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.224024 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0b41fedb-e77f-45d8-9682-5e545efa5335 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/ips" status: 200 len: 150 microversion: 2.1 time: 0.163667 Aug 31 09:53:48.224635 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 317/639] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:53:48 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/ips => generated 150 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:48.229559 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-964f3baa-a0a8-4ee5-a488-6713759397a7 req-0ad7ffdf-c04f-4788-99ab-6235e5c7da26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ffd309-4ae6-48c6-ac5d-740538eee04a", "name": "network-vif-deleted", "tag": "0527b895-2177-4cb0-9f5a-08f0343398af"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:48.244213 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-964f3baa-a0a8-4ee5-a488-6713759397a7 req-0ad7ffdf-c04f-4788-99ab-6235e5c7da26 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:48.244693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-964f3baa-a0a8-4ee5-a488-6713759397a7 req-0ad7ffdf-c04f-4788-99ab-6235e5c7da26 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:48.245119 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-964f3baa-a0a8-4ee5-a488-6713759397a7 req-0ad7ffdf-c04f-4788-99ab-6235e5c7da26 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:48.265633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:48.277148 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-481b9e87-7cd6-4e4a-ba6e-691ef064d5e7 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 200 len: 1330 microversion: 2.1 time: 0.119210 Aug 31 09:53:48.278260 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 323/640] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:48 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 1330 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:48.280985 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-964f3baa-a0a8-4ee5-a488-6713759397a7 req-0ad7ffdf-c04f-4788-99ab-6235e5c7da26 service nova] Creating event network-vif-deleted:0527b895-2177-4cb0-9f5a-08f0343398af for instance d2ffd309-4ae6-48c6-ac5d-740538eee04a on hv-cinder-83754 Aug 31 09:53:48.287741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-964f3baa-a0a8-4ee5-a488-6713759397a7 req-0ad7ffdf-c04f-4788-99ab-6235e5c7da26 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059973 Aug 31 09:53:48.288820 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 318/641] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:49.171229 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:49.171864 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:49.179235 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.179999 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.180593 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.181467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.182077 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.182682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.299560 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:49.300269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: d2ffd309-4ae6-48c6-ac5d-740538eee04a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:49.307143 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.307634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.308066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.308766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.316077 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.316670 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.333716 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:49.339036 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] HTTP exception thrown: Instance d2ffd309-4ae6-48c6-ac5d-740538eee04a could not be found. Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Request method failure captured: Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a HTTP/1.1 Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy5w7w6erjIccgUn-R2MYFy0wkKrnLBZ8G0LGzYBZIz-xcb-8Yn8UHnEdSssEMHV_zHLnUCz5n-M6ZjRm_k6YKV_oUnpLJFvOHsBqUCszrB3lOV_RHTzo8YIEsVmnEd7B9ET6Gqe4YcmIzrJ5bZ1232bHyDzwV1FphlF0D2Y1EIcJzk Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:53:49.340766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: b8818863a81b4238a22035fbb256568e Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance d2ffd309-4ae6-48c6-ac5d-740538eee04a could not be found. Aug 31 09:53:49.342126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'd2ffd309-4ae6-48c6-ac5d-740538eee04a'} Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ffd309-4ae6-48c6-ac5d-740538eee04a could not be found. Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:49.343062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ffd309-4ae6-48c6-ac5d-740538eee04a could not be found. Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ffd309-4ae6-48c6-ac5d-740538eee04a could not be found. Aug 31 09:53:49.344472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:53:49.345638 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Returning 404 to user: Instance d2ffd309-4ae6-48c6-ac5d-740538eee04a could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:49.345638 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-26ae8143-3b03-4cf2-bbf8-bf91c7fb0c12 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a" status: 404 len: 111 microversion: 2.1 time: 0.048029 Aug 31 09:53:49.346062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 319/642] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:49 2022] GET /compute/v2.1/servers/d2ffd309-4ae6-48c6-ac5d-740538eee04a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:53:49.351976 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fb712ed3-2ef8-4a77-815e-82d7bba06122 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '.version_select at 0x7f9462a134c0>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:49.355814 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:49.358619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:49.359865 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c84dbde4-605f-462a-bb71-f4999b1ee557 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1406 microversion: 2.20 time: 0.194328 Aug 31 09:53:49.372081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 324/643] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:49 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:49.394865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fb712ed3-2ef8-4a77-815e-82d7bba06122 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979349837" status: 202 len: 0 microversion: 2.1 time: 0.047405 Aug 31 09:53:49.395869 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 320/644] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 09:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979349837 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:53:49.760244 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dbf4c90f-0f71-4d83-b83a-774cba1bcc70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:49.762778 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dbf4c90f-0f71-4d83-b83a-774cba1bcc70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:49.769192 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbf4c90f-0f71-4d83-b83a-774cba1bcc70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.769696 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbf4c90f-0f71-4d83-b83a-774cba1bcc70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.770126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbf4c90f-0f71-4d83-b83a-774cba1bcc70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:49.770854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbf4c90f-0f71-4d83-b83a-774cba1bcc70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:49.771346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbf4c90f-0f71-4d83-b83a-774cba1bcc70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:49.772180 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dbf4c90f-0f71-4d83-b83a-774cba1bcc70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.109476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dbf4c90f-0f71-4d83-b83a-774cba1bcc70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353619 Aug 31 09:53:50.110346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 325/645] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:53:49 2022] POST /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:50.306575 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-685e4875-b027-4bd5-b2db-04e717241526 req-37a17fda-34cb-46f8-babd-95c67aefd072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2a31fa-a87b-468d-8e3b-5065c7b93903", "tag": "c40dae88-cb20-491c-85ea-9cf688dd1840"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:50.320966 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-685e4875-b027-4bd5-b2db-04e717241526 req-37a17fda-34cb-46f8-babd-95c67aefd072 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.321537 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-685e4875-b027-4bd5-b2db-04e717241526 req-37a17fda-34cb-46f8-babd-95c67aefd072 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.321971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-685e4875-b027-4bd5-b2db-04e717241526 req-37a17fda-34cb-46f8-babd-95c67aefd072 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.333751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-685e4875-b027-4bd5-b2db-04e717241526 req-37a17fda-34cb-46f8-babd-95c67aefd072 service nova] Creating event network-changed:c40dae88-cb20-491c-85ea-9cf688dd1840 for instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 on hv-cinder-83754 Aug 31 09:53:50.340568 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-685e4875-b027-4bd5-b2db-04e717241526 req-37a17fda-34cb-46f8-babd-95c67aefd072 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037455 Aug 31 09:53:50.341542 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 321/646] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:50.385171 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:50.385903 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:50.392151 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.392643 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.393078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.393780 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:50.394394 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:50.394822 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:50.553069 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:50.561491 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:50.562916 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:50.564274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1f4ad4f2-695d-4d90-ad8a-994fa5be6e04 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1406 microversion: 2.20 time: 0.183991 Aug 31 09:53:50.565091 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 326/647] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:50 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:51.589416 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:51.590031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:51.596838 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.597320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.597751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.598451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:51.598898 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:51.599357 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:51.852622 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:51.861402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:51.862840 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:51.863982 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8fd85f6b-9f6b-44f2-a693-4f2d9b71969d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1406 microversion: 2.20 time: 0.279533 Aug 31 09:53:51.864543 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 322/648] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:51 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:52.792161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:52.792708 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:52.795140 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:52.800647 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.801136 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.801572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.802270 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.803346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.803938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.833319 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:52.887192 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:52.887798 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:52.894267 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.894749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.895211 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.895905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.896366 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.896803 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.913558 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c7fefb04-67f5-45be-834d-641d192ce081 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "DELETE /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 204 len: 0 microversion: 2.1 time: 0.123757 Aug 31 09:53:52.914360 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 327/649] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:52 2022] DELETE /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:53:52.923411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:52.924117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:52.930802 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.931764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:52.932462 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:52.932916 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:52.933337 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:53.042428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:53.051112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:53.052578 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:53.054852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1f8552e6-86b1-405e-8a8a-44674aa279a3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1406 microversion: 2.20 time: 0.171616 Aug 31 09:53:53.055456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 323/650] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:52 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:53:53.307930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:53.312899 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:53.320339 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9b5eea78-e107-4d23-a4f8-95b193e04384 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1506 microversion: 2.1 time: 0.401340 Aug 31 09:53:53.320949 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 328/651] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:52 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:54.077113 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:54.078067 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:54.084659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.085152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.085591 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.086320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.086779 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.087230 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.220648 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:54.229051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:54.230914 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:54.232194 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-88ba3192-1c7d-4202-a3ec-9e01f4d0348d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1406 microversion: 2.20 time: 0.159155 Aug 31 09:53:54.232882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 324/652] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:54 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:54.342729 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:54.343370 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:54.351104 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.351617 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.352053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.352754 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:54.353205 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:54.353630 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:54.501677 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:54.509925 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6f0a5551-2eef-4c94-8b55-2e47447022fc tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1506 microversion: 2.1 time: 0.171536 Aug 31 09:53:54.510514 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 329/653] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:54 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:55.254778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:55.255416 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:55.262171 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:55.262651 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:55.263080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:55.263794 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:55.264273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:55.264692 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:55.398164 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:55.406210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:55.407683 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:55.408782 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-705a8cd5-7b68-4b31-8957-9c836111c3f1 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1406 microversion: 2.20 time: 0.158535 Aug 31 09:53:55.409347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 325/654] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:55 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:55.530387 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:55.530995 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:55.538145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:55.538633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:55.539072 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:55.539834 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:55.540261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:55.540688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:55.688854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:55.699314 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ce1219d4-5e4e-4eb5-a7da-e6bb88320571 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1506 microversion: 2.1 time: 0.172472 Aug 31 09:53:55.700309 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 330/655] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:55 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:55.884892 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-23e5425f-8b1f-4379-aea7-d35e2dda2a28 req-72b440e3-d9fd-4f18-b233-977be60fe713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2a31fa-a87b-468d-8e3b-5065c7b93903", "name": "network-vif-plugged", "status": "completed", "tag": "c40dae88-cb20-491c-85ea-9cf688dd1840"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:55.891606 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:55.892768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=10 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:55.898102 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-23e5425f-8b1f-4379-aea7-d35e2dda2a28 req-72b440e3-d9fd-4f18-b233-977be60fe713 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:55.898795 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-23e5425f-8b1f-4379-aea7-d35e2dda2a28 req-72b440e3-d9fd-4f18-b233-977be60fe713 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:55.899499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-23e5425f-8b1f-4379-aea7-d35e2dda2a28 req-72b440e3-d9fd-4f18-b233-977be60fe713 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:55.913566 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-23e5425f-8b1f-4379-aea7-d35e2dda2a28 req-72b440e3-d9fd-4f18-b233-977be60fe713 service nova] Creating event network-vif-plugged:c40dae88-cb20-491c-85ea-9cf688dd1840 for instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 on hv-cinder-83754 Aug 31 09:53:55.918849 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-23e5425f-8b1f-4379-aea7-d35e2dda2a28 req-72b440e3-d9fd-4f18-b233-977be60fe713 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038464 Aug 31 09:53:55.920164 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 326/656] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:56.067796 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-36cd2667-ca8d-49f3-ae8f-7223c6749ce3 req-f8a2dedd-adaa-4775-9290-5bdbe4fa8cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44963711-215e-4aca-bdfb-7d22be495691", "name": "network-vif-deleted", "tag": "3e4253e5-5b4e-4671-ad15-d6b2b34c4cba"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:56.077587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:56.080443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-36cd2667-ca8d-49f3-ae8f-7223c6749ce3 req-f8a2dedd-adaa-4775-9290-5bdbe4fa8cee service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.081940 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-36cd2667-ca8d-49f3-ae8f-7223c6749ce3 req-f8a2dedd-adaa-4775-9290-5bdbe4fa8cee service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.082574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-36cd2667-ca8d-49f3-ae8f-7223c6749ce3 req-f8a2dedd-adaa-4775-9290-5bdbe4fa8cee service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.095560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-36cd2667-ca8d-49f3-ae8f-7223c6749ce3 req-f8a2dedd-adaa-4775-9290-5bdbe4fa8cee service nova] Creating event network-vif-deleted:3e4253e5-5b4e-4671-ad15-d6b2b34c4cba for instance 44963711-215e-4aca-bdfb-7d22be495691 on hv-cinder-83754 Aug 31 09:53:56.101850 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-36cd2667-ca8d-49f3-ae8f-7223c6749ce3 req-f8a2dedd-adaa-4775-9290-5bdbe4fa8cee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037577 Aug 31 09:53:56.102749 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 331/657] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:53:56.434072 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:56.435108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:56.443907 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.444556 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.445865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.446790 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.447286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.447729 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.593690 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:56.603905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:56.605382 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:56.606493 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-06685e22-72bf-4a5c-ad46-3f7431bf0c23 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1406 microversion: 2.20 time: 0.177489 Aug 31 09:53:56.607057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 327/658] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:56 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:56.723250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:56.724009 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:56.730671 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.731146 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.731621 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.732312 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.732766 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.733187 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.765432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:56.765910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:56.766344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:56.766891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lazy-loading 'fault' on Instance uuid 44963711-215e-4aca-bdfb-7d22be495691 {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:56.810816 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:56.819280 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5963b0e5-4823-434b-a186-4a0ddf2dfe6a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1311 microversion: 2.1 time: 0.100667 Aug 31 09:53:56.819871 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 332/659] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:56 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:57.628994 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:57.630099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:57.637751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:57.638266 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:57.638976 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.639720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:57.640184 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:57.640620 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.781764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:57.791086 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:57.792564 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:57.793706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-51b11815-4fe1-4f50-bada-ae488ab34ae5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1406 microversion: 2.20 time: 0.168694 Aug 31 09:53:57.794265 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 328/660] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:57 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:57.840988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:57.841524 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:57.848004 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:57.848489 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:57.848922 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.849696 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:57.850154 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:57.851080 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.881938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:57.882420 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:57.882853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:57.883332 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lazy-loading 'fault' on Instance uuid 44963711-215e-4aca-bdfb-7d22be495691 {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:53:57.926700 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:57.934456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-45596086-81b6-433f-84f2-d7d9b5392de0 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 200 len: 1311 microversion: 2.1 time: 0.097434 Aug 31 09:53:57.935032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 333/661] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:57 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:53:58.821626 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:58.822248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:58.828859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:58.829563 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:58.830008 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:58.830711 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:58.831365 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:58.831792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:58.957447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:58.958475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 44963711-215e-4aca-bdfb-7d22be495691] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:58.968345 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:58.969212 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:58.970000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:58.970852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:58.971636 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:58.972287 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:58.988833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] HTTP exception thrown: Instance 44963711-215e-4aca-bdfb-7d22be495691 could not be found. Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Request method failure captured: Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 HTTP/1.1 Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy5w7w6erjIccgUn-R2MYFy0wkKrnLBZ8G0LGzYBZIz-xcb-8Yn8UHnEdSssEMHV_zHLnUCz5n-M6ZjRm_k6YKV_oUnpLJFvOHsBqUCszrB3lOV_RHTzo8YIEsVmnEd7B9ET6Gqe4YcmIzrJ5bZ1232bHyDzwV1FphlF0D2Y1EIcJzk Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:53:58.991457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: b8818863a81b4238a22035fbb256568e Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance 44963711-215e-4aca-bdfb-7d22be495691 could not be found. Aug 31 09:53:58.993070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': '44963711-215e-4aca-bdfb-7d22be495691'} Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44963711-215e-4aca-bdfb-7d22be495691 could not be found. Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:58.993996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44963711-215e-4aca-bdfb-7d22be495691 could not be found. Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44963711-215e-4aca-bdfb-7d22be495691 could not be found. Aug 31 09:53:58.995774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:58.997022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Returning 404 to user: Instance 44963711-215e-4aca-bdfb-7d22be495691 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:58.997022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9991b4c9-a015-4563-9403-30314240849c tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691" status: 404 len: 111 microversion: 2.1 time: 0.040754 Aug 31 09:53:58.997022 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 334/662] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:58 2022] GET /compute/v2.1/servers/44963711-215e-4aca-bdfb-7d22be495691 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:53:59.002355 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:59.002855 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:59.009992 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.010500 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.010941 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.011885 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.012346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.012774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.041849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:53:59.134137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b01ba40d-32a5-4c58-ade5-9d8838d58e44 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "DELETE /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 204 len: 0 microversion: 2.1 time: 0.135170 Aug 31 09:53:59.134834 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 335/663] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:53:58 2022] DELETE /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:53:59.145667 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:59.146482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:59.152881 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.153375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.153810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.154518 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.154973 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.155429 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.249374 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:59.253153 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:59.259293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:59.260852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:59.262114 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-31f82dd7-a523-414a-8bfb-cdabbf095b0a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1597 microversion: 2.20 time: 0.449758 Aug 31 09:53:59.262808 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 329/664] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:53:58 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1597 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:53:59.284931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-28b53c66-a593-46e9-a9b3-c00f72fb06a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:53:59.285425 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-28b53c66-a593-46e9-a9b3-c00f72fb06a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:59.293425 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28b53c66-a593-46e9-a9b3-c00f72fb06a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.293834 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28b53c66-a593-46e9-a9b3-c00f72fb06a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.294276 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28b53c66-a593-46e9-a9b3-c00f72fb06a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.294985 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28b53c66-a593-46e9-a9b3-c00f72fb06a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.295484 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28b53c66-a593-46e9-a9b3-c00f72fb06a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.296562 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28b53c66-a593-46e9-a9b3-c00f72fb06a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.304300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:53:59.312049 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-64a75ebc-34f1-45a9-8e56-37ee9a346b18 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.170959 Aug 31 09:53:59.312632 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 336/665] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:53:59 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:53:59.391746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-28b53c66-a593-46e9-a9b3-c00f72fb06a7 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.110853 Aug 31 09:53:59.392343 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 330/666] 10.222.0.36 () {60 vars in 1316 bytes} [Wed Aug 31 09:53:59 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 09:53:59.831466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:53:59.834476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:53:59.840901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.841376 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.841886 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.842576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:53:59.843017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:53:59.843470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:53:59.929559 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Invalid volume: volume f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd is already attached to instances: 37b2cb47-9a46-450e-8bd9-f125d5aba697 Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: POST /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments HTTP/1.1 Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 74 Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:53:59.931322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {"volumeAttachment": {"volumeId": "f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd"}} Aug 31 09:53:59.932748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Invalid volume: volume f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd is already attached to instances: 37b2cb47-9a46-450e-8bd9-f125d5aba697 Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'server_id': '37b2cb47-9a46-450e-8bd9-f125d5aba697', 'body': {'volumeAttachment': {'volumeId': 'f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd'}}} Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd is already attached to instances: 37b2cb47-9a46-450e-8bd9-f125d5aba697 Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:59.933445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd is already attached to instances: 37b2cb47-9a46-450e-8bd9-f125d5aba697 Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:53:59.934587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:53:59.935831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:53:59.935831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:53:59.935831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:53:59.935831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd is already attached to instances: 37b2cb47-9a46-450e-8bd9-f125d5aba697 Aug 31 09:53:59.935831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:53:59.935831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 400 to user: Invalid volume: volume f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd is already attached to instances: 37b2cb47-9a46-450e-8bd9-f125d5aba697 {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:53:59.935831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-17a1b1a2-ef5b-4b66-90bc-97fcc87fbdbf tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105404 Aug 31 09:53:59.935831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 337/667] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:53:59 2022] POST /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:54:00.004887 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:00.005451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:00.011639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.012137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.012579 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.013280 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.013735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.014165 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.099098 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lazy-loading 'services' on Instance uuid 37b2cb47-9a46-450e-8bd9-f125d5aba697 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:00.175405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f1b4a598-cd3e-4a9b-a68d-996d1f68ba23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments/f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd" status: 202 len: 0 microversion: 2.1 time: 0.174834 Aug 31 09:54:00.175996 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 331/668] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:53:59 2022] DELETE /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments/f19a72a5-71c4-44ae-a8f4-e7eb209f9dfd => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:00.184366 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-284d216d-8c2d-4933-97de-0b1eda1d4f70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:00.186520 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-284d216d-8c2d-4933-97de-0b1eda1d4f70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:00.193305 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284d216d-8c2d-4933-97de-0b1eda1d4f70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.193884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284d216d-8c2d-4933-97de-0b1eda1d4f70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.194317 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284d216d-8c2d-4933-97de-0b1eda1d4f70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.195042 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284d216d-8c2d-4933-97de-0b1eda1d4f70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.195596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284d216d-8c2d-4933-97de-0b1eda1d4f70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.196056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284d216d-8c2d-4933-97de-0b1eda1d4f70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.228031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-284d216d-8c2d-4933-97de-0b1eda1d4f70 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047544 Aug 31 09:54:00.228606 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 338/669] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:54:00 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:54:00.334617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:00.335848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:00.342287 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.342924 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.343453 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.344164 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.344621 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.345069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.529933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:00.541138 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-68639c88-c8dd-4a4d-a171-e5a6046aea05 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.211415 Aug 31 09:54:00.541745 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 332/670] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:00 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:00.565275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-ac45775c-3bf6-4baa-9507-7c9c73d9dab7 req-3456fa6a-0b5a-48f0-9ea4-1dc730c5a4ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2a31fa-a87b-468d-8e3b-5065c7b93903", "tag": "c40dae88-cb20-491c-85ea-9cf688dd1840"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:00.575090 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-ac45775c-3bf6-4baa-9507-7c9c73d9dab7 req-3456fa6a-0b5a-48f0-9ea4-1dc730c5a4ba service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:00.575599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-ac45775c-3bf6-4baa-9507-7c9c73d9dab7 req-3456fa6a-0b5a-48f0-9ea4-1dc730c5a4ba service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:00.576656 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-ac45775c-3bf6-4baa-9507-7c9c73d9dab7 req-3456fa6a-0b5a-48f0-9ea4-1dc730c5a4ba service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:00.588317 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-ac45775c-3bf6-4baa-9507-7c9c73d9dab7 req-3456fa6a-0b5a-48f0-9ea4-1dc730c5a4ba service nova] Creating event network-changed:c40dae88-cb20-491c-85ea-9cf688dd1840 for instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 on hv-cinder-83754 Aug 31 09:54:00.593350 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-ac45775c-3bf6-4baa-9507-7c9c73d9dab7 req-3456fa6a-0b5a-48f0-9ea4-1dc730c5a4ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107802 Aug 31 09:54:00.594159 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 339/671] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:54:01.241331 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7bca310c-408a-4d68-be76-1764dec89919 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:01.243609 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7bca310c-408a-4d68-be76-1764dec89919 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:01.250418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7bca310c-408a-4d68-be76-1764dec89919 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:01.250906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7bca310c-408a-4d68-be76-1764dec89919 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:01.251375 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7bca310c-408a-4d68-be76-1764dec89919 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:01.252079 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7bca310c-408a-4d68-be76-1764dec89919 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:01.252535 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7bca310c-408a-4d68-be76-1764dec89919 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:01.253710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7bca310c-408a-4d68-be76-1764dec89919 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:01.289850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7bca310c-408a-4d68-be76-1764dec89919 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052629 Aug 31 09:54:01.290971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 333/672] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:54:01 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:01.563697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:01.564384 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:01.571216 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:01.571694 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:01.572122 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:01.572838 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:01.573289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:01.573701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:01.713001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:01.720828 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fd87360c-3d54-4238-88c0-3b2439e75c0b tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.161810 Aug 31 09:54:01.721408 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 340/673] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:01 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:02.302011 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6e7bdaff-5f95-40e5-b989-ef67cc522f43 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:02.304553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6e7bdaff-5f95-40e5-b989-ef67cc522f43 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:02.311077 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e7bdaff-5f95-40e5-b989-ef67cc522f43 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:02.311602 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e7bdaff-5f95-40e5-b989-ef67cc522f43 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:02.312041 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e7bdaff-5f95-40e5-b989-ef67cc522f43 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:02.312739 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e7bdaff-5f95-40e5-b989-ef67cc522f43 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:02.313200 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e7bdaff-5f95-40e5-b989-ef67cc522f43 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:02.313623 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6e7bdaff-5f95-40e5-b989-ef67cc522f43 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:02.344124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6e7bdaff-5f95-40e5-b989-ef67cc522f43 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045960 Aug 31 09:54:02.344606 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 334/674] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:54:02 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:02.745550 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:02.746192 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:02.752969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:02.753448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:02.753882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:02.754566 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:02.755018 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:02.755472 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:02.888423 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:02.896109 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7fd2dbb6-40b2-4bcb-b81e-8cc2aedcaa76 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1521 microversion: 2.1 time: 0.154454 Aug 31 09:54:02.896682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 341/675] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:02 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:03.358145 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b17b2308-737f-49fe-8eda-770fe9303536 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:03.361661 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b17b2308-737f-49fe-8eda-770fe9303536 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:03.367941 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b17b2308-737f-49fe-8eda-770fe9303536 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.368554 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b17b2308-737f-49fe-8eda-770fe9303536 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.369053 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b17b2308-737f-49fe-8eda-770fe9303536 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.369985 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b17b2308-737f-49fe-8eda-770fe9303536 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.370532 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b17b2308-737f-49fe-8eda-770fe9303536 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.371025 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b17b2308-737f-49fe-8eda-770fe9303536 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.403556 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b17b2308-737f-49fe-8eda-770fe9303536 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050008 Aug 31 09:54:03.404145 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 335/676] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:54:03 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 09:54:03.468654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:03.469161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:03.476308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.476832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.477260 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.477957 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.478410 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.478833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.505298 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:54:03.608956 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2478bc5c-d5d8-4fa4-8a97-f2208540ad65 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 204 len: 0 microversion: 2.1 time: 0.143894 Aug 31 09:54:03.613280 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 342/677] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:54:03 2022] DELETE /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:54:03.620531 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:03.621735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:03.629622 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.630115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.630571 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.631432 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.632413 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.632853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.785148 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-6f87590e-91be-4378-9353-32554757f042 req-e96bd966-ce25-4c83-9dea-56ca48c9ba36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52ff3858-3242-45d8-ad69-757d5b9c6d7c", "name": "network-vif-deleted", "tag": "6f61b202-be56-46f9-938f-4a4424b4710e"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:03.795918 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-6f87590e-91be-4378-9353-32554757f042 req-e96bd966-ce25-4c83-9dea-56ca48c9ba36 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.796392 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-6f87590e-91be-4378-9353-32554757f042 req-e96bd966-ce25-4c83-9dea-56ca48c9ba36 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.796810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-6f87590e-91be-4378-9353-32554757f042 req-e96bd966-ce25-4c83-9dea-56ca48c9ba36 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.808760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-6f87590e-91be-4378-9353-32554757f042 req-e96bd966-ce25-4c83-9dea-56ca48c9ba36 service nova] Creating event network-vif-deleted:6f61b202-be56-46f9-938f-4a4424b4710e for instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c on hv-cinder-83754 Aug 31 09:54:03.813736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-6f87590e-91be-4378-9353-32554757f042 req-e96bd966-ce25-4c83-9dea-56ca48c9ba36 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Aug 31 09:54:03.814347 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 343/678] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:54:03.829049 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:03.840240 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-28c1d252-4504-4cba-b20d-b94074e0d4ab tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1683 microversion: 2.1 time: 0.225918 Aug 31 09:54:03.840757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 336/679] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:03 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:03.918615 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:03.919342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:03.925529 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.926018 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.926454 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.927162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:03.927621 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:03.928194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:03.932475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:04.000524 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:04.008495 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9b71eb29-f77e-4b08-a1c3-d38857655c02 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1479 microversion: 2.1 time: 0.094069 Aug 31 09:54:04.009074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 344/680] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:03 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1479 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:04.341166 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:04.341596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:04.347710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.348203 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.348647 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:04.349357 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.350372 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.350812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:04.377885 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Going to try to terminate instance {{(pid=132571) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:54:04.466195 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-baa8708a-86a0-41cc-b510-8637ef4a8eda tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "DELETE /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 204 len: 0 microversion: 2.1 time: 0.128577 Aug 31 09:54:04.467153 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 337/681] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:54:04 2022] DELETE /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:54:04.476719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:04.477329 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:04.483862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.484345 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.484774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:04.485467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.485917 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.486335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:04.624910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:04.636734 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-86559b3f-5669-45bc-9e5c-9d76c82780aa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1576 microversion: 2.1 time: 0.164612 Aug 31 09:54:04.637270 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 345/682] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:04 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:04.862970 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:04.863708 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:04.869621 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.870106 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.870540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:04.871259 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:04.871719 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:04.872153 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:05.007843 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:05.015728 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f0f63e29-0a67-428a-9fc3-5fb79ab0934a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1683 microversion: 2.1 time: 0.157025 Aug 31 09:54:05.016299 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 338/683] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:04 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:05.029657 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:05.030262 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:05.036770 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:05.037296 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:05.037825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:05.038668 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:05.039113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:05.039557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:05.103441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:05.111611 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-679cff50-de83-4f5d-8f7a-d9f73be7434a tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1479 microversion: 2.1 time: 0.085547 Aug 31 09:54:05.112229 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 346/684] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:05 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1479 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:05.658590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:05.659238 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:05.666550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:05.667038 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:05.667514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:05.668223 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:05.668770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:05.669108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:05.805863 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:05.813648 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e9921e69-3af4-4bba-b86d-9323ddec4524 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1576 microversion: 2.1 time: 0.158971 Aug 31 09:54:05.814226 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 339/685] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:05 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:06.036811 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:06.038084 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:06.045005 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.045494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.045930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.046637 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.047087 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.047541 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.135376 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:06.136337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:06.142482 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.142966 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.143428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.144299 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.144666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.145086 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.204177 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:06.212887 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0c9d9c0a-7804-45d4-8f99-379813ecadd9 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1683 microversion: 2.1 time: 0.180051 Aug 31 09:54:06.213652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 347/686] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:06 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:06.214418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:06.222502 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b6832637-e8dc-4c4a-84fe-cc0567bdb919 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1307 microversion: 2.1 time: 0.091587 Aug 31 09:54:06.223264 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 340/687] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:06 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1307 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:06.836371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:06.836899 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:06.843091 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.847685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.847685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.847685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:06.847685 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:06.848220 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:06.984211 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:06.991946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0dd6a334-3708-40b7-bf0c-dee007793aa9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1576 microversion: 2.1 time: 0.160289 Aug 31 09:54:06.992580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 348/688] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:06 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:07.234949 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:07.235634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:07.242696 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:07.243343 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:07.243924 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:07.244402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:07.244837 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:07.245561 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:07.246012 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:07.246434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:07.249938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:07.251857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:07.251857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:07.251857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:07.252181 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:07.252413 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:07.284853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:07.285329 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:07.285768 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:07.286226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lazy-loading 'fault' on Instance uuid 52ff3858-3242-45d8-ad69-757d5b9c6d7c {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:07.333082 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8818863a81b4238a22035fbb256568e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfef7bc61a644c12a42cc17b1aed1b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:07.341225 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5d69cf09-f9a3-4581-bcd0-0bdf605eff66 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 200 len: 1312 microversion: 2.1 time: 0.102188 Aug 31 09:54:07.342017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 349/689] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:07 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:07.614160 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:07.623068 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-04ecf68a-42cd-4415-93f6-b3005c3c987b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1683 microversion: 2.1 time: 0.391591 Aug 31 09:54:07.623722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 341/690] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:07 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1683 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:08.014478 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:08.015152 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:08.021448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:08.021946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:08.022386 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:08.023956 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:08.024612 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:08.025242 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:08.172841 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:08.182046 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c2a3f83c-6771-4905-8ab6-ccc2daea3cf5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1576 microversion: 2.1 time: 0.171833 Aug 31 09:54:08.182644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 350/691] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:08 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:08.363035 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:08.363682 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] [instance: 52ff3858-3242-45d8-ad69-757d5b9c6d7c] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:08.370636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:08.371155 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:08.371736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:08.372697 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:08.373175 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:08.373610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:08.388885 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] HTTP exception thrown: Instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c could not be found. Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Request method failure captured: Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c HTTP/1.1 Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy5w7w6erjIccgUn-R2MYFy0wkKrnLBZ8G0LGzYBZIz-xcb-8Yn8UHnEdSssEMHV_zHLnUCz5n-M6ZjRm_k6YKV_oUnpLJFvOHsBqUCszrB3lOV_RHTzo8YIEsVmnEd7B9ET6Gqe4YcmIzrJ5bZ1232bHyDzwV1FphlF0D2Y1EIcJzk Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:54:08.390534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bfef7bc61a644c12a42cc17b1aed1b31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: bfef7bc61a644c12a42cc17b1aed1b31 Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-261714108 Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: b8818863a81b4238a22035fbb256568e Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-ServerRescueNegativeTestJSON-261714108-project Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c could not be found. Aug 31 09:54:08.392237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '52ff3858-3242-45d8-ad69-757d5b9c6d7c'} Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c could not be found. Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:54:08.393124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c could not be found. Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c could not be found. Aug 31 09:54:08.394546 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:08.395874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] Returning 404 to user: Instance 52ff3858-3242-45d8-ad69-757d5b9c6d7c could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:54:08.395874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ae9b14ef-7d81-4410-b254-f712d01d02f1 tempest-ServerRescueNegativeTestJSON-261714108 tempest-ServerRescueNegativeTestJSON-261714108-project] 10.222.0.36 "GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c" status: 404 len: 111 microversion: 2.1 time: 0.033147 Aug 31 09:54:08.396523 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 342/692] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:08 2022] GET /compute/v2.1/servers/52ff3858-3242-45d8-ad69-757d5b9c6d7c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:54:08.646554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:08.647943 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:08.654944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:08.655456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:08.656063 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:08.657016 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:08.657628 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:08.658052 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:08.735216 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:08.744659 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-da293d40-e7cf-4387-932c-a59eaac90b23 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1615 microversion: 2.1 time: 0.102325 Aug 31 09:54:08.745566 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 351/693] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:08 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1615 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:09.131368 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-75918920-17d8-45c5-b308-41aa5d08ba17 req-abe11d17-9d98-4acb-b21c-0eeadc02a67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b2cb47-9a46-450e-8bd9-f125d5aba697", "name": "network-vif-deleted", "tag": "68efd6e2-678a-4fe0-bc21-3945918693d2"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:09.165011 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-75918920-17d8-45c5-b308-41aa5d08ba17 req-abe11d17-9d98-4acb-b21c-0eeadc02a67f service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:09.170662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-75918920-17d8-45c5-b308-41aa5d08ba17 req-abe11d17-9d98-4acb-b21c-0eeadc02a67f service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:09.171298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-75918920-17d8-45c5-b308-41aa5d08ba17 req-abe11d17-9d98-4acb-b21c-0eeadc02a67f service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.207269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:09.207890 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:09.222412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-75918920-17d8-45c5-b308-41aa5d08ba17 req-abe11d17-9d98-4acb-b21c-0eeadc02a67f service nova] Creating event network-vif-deleted:68efd6e2-678a-4fe0-bc21-3945918693d2 for instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 on hv-cinder-83754 Aug 31 09:54:09.236514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-75918920-17d8-45c5-b308-41aa5d08ba17 req-abe11d17-9d98-4acb-b21c-0eeadc02a67f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111104 Aug 31 09:54:09.236829 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:09.241920 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 343/694] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:09.248992 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:09.252340 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.253297 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:09.260556 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:09.262066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.395505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:09.412190 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0318f4a0-f125-4581-9541-ede919d705ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1509 microversion: 2.1 time: 0.210257 Aug 31 09:54:09.412796 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 352/695] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:09 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:09.776644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:09.777637 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:09.791154 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:09.791662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:09.792101 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.795405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:09.796183 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:09.798347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.877216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:09.877772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:09.878321 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:09.878782 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lazy-loading 'fault' on Instance uuid 37b2cb47-9a46-450e-8bd9-f125d5aba697 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:09.981677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:10.004726 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e0ece947-7931-465c-b4c1-364af0ca6d7f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 200 len: 1332 microversion: 2.1 time: 0.241024 Aug 31 09:54:10.014159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 344/696] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:09 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 1332 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:10.436970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:10.438356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:10.447244 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:10.447979 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:10.449069 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:10.449948 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:10.450575 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:10.451186 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:10.496121 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:10.496862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:10.497882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:10.498600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lazy-loading 'fault' on Instance uuid 468a13bb-2c16-4395-8ce5-afa5895c6111 {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:10.565200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:10.595055 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-aedb6008-2ae3-47c8-a3d6-581486e008da tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 200 len: 1230 microversion: 2.1 time: 0.150065 Aug 31 09:54:10.595789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 353/697] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:10 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 1230 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:11.035283 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:11.036056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:11.042708 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:11.043229 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:11.043666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:11.044512 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:11.044968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:11.045390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:11.061087 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 HTTP/1.1 Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:54:11.062742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:54:11.064093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '37b2cb47-9a46-450e-8bd9-f125d5aba697'} Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:54:11.064844 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:54:11.065988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.067035 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:54:11.067035 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-05c4f107-0f5f-4383-9e46-196ab535d31f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 404 len: 111 microversion: 2.1 time: 0.033055 Aug 31 09:54:11.067035 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 345/698] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:11 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:54:11.077221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-98b8ce9c-b518-4b6c-be44-de5bb5c6f75c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '.version_select at 0x7f9462aab550>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:11.096090 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-98b8ce9c-b518-4b6c-be44-de5bb5c6f75c tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1083125049" status: 202 len: 0 microversion: 2.1 time: 0.026644 Aug 31 09:54:11.096868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 354/699] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Aug 31 09:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1083125049 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:11.340210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-421e0bc0-c90c-4ea5-b0a4-54c21a8aa689 req-ca695869-c10f-4684-b40f-fde35534abed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "468a13bb-2c16-4395-8ce5-afa5895c6111", "name": "network-vif-deleted", "tag": "7cd12c4f-2837-4b86-8989-989cb73c2d2e"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:11.351402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-421e0bc0-c90c-4ea5-b0a4-54c21a8aa689 req-ca695869-c10f-4684-b40f-fde35534abed service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:11.352189 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-421e0bc0-c90c-4ea5-b0a4-54c21a8aa689 req-ca695869-c10f-4684-b40f-fde35534abed service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:11.352717 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-421e0bc0-c90c-4ea5-b0a4-54c21a8aa689 req-ca695869-c10f-4684-b40f-fde35534abed service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:11.356989 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:11.365439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-421e0bc0-c90c-4ea5-b0a4-54c21a8aa689 req-ca695869-c10f-4684-b40f-fde35534abed service nova] Creating event network-vif-deleted:7cd12c4f-2837-4b86-8989-989cb73c2d2e for instance 468a13bb-2c16-4395-8ce5-afa5895c6111 on hv-cinder-83754 Aug 31 09:54:11.371619 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-421e0bc0-c90c-4ea5-b0a4-54c21a8aa689 req-ca695869-c10f-4684-b40f-fde35534abed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035932 Aug 31 09:54:11.372842 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 346/700] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:11.620344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:11.620968 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:11.632323 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:11.633045 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:11.633562 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:11.634159 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:11.634621 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:11.635048 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:11.651082 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] HTTP exception thrown: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Request method failure captured: Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 HTTP/1.1 Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy8Ir8ZylJRAXm4qtYFtPlnT4xr6o9k9azhjHgJN4LC__98UntzAqsCKzy7uxpctYSz7duNSOt1295SVz_YIGr2X09ZKXe0oGZnzjFmXpbSAN5I-4N4fq7Viwt2kvYQ3WvttHC4FOgpG0fM7KFKCz0l1ki4NJBVyFJ2wAcIOqMFuHbU Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:54:11.652988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 893e06c5ea99497fae2847399b7a1a3c Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:54:11.654580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': '468a13bb-2c16-4395-8ce5-afa5895c6111'} Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:54:11.655421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:54:11.656806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:54:11.658744 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Returning 404 to user: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:54:11.660076 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f778eb9b-e09e-4a9b-aa6b-521c7cde0a32 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 404 len: 111 microversion: 2.1 time: 0.044697 Aug 31 09:54:11.661462 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 355/701] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:11 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:54:11.723452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1450131241", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-790377107", "security_groups": [{"name": "tempest-secgroup-smoke-817822166"}], "block_device_mapping_v2": [{"uuid": "3fe13405-4e50-4276-bae1-ea37fbb78f22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c93cbb45-31b4-4c55-8a58-3426eb15ee6e"}]}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:11.886588 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b532e946-c82c-42ac-8138-cc4777119f96 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: .version_select at 0x7f94629ea3a0>, body: {"keypair": {"name": "tempest-keypair-812361715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4OUIZozETVky5mdsHPpRzlXP9sqb6Oaz1HzjYhcNKDHWVPLUPSWQe26U43lPDxp4I/e2t1Z77ZryOlPMqawFcuDND5SyMVYkveL15l2AHhlwfP5rKNevFmOm2pZHazyg=="}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:11.906194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-b532e946-c82c-42ac-8138-cc4777119f96 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for project c4914faafb494e5bb323114853f25c54. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:54:11.911035 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-b532e946-c82c-42ac-8138-cc4777119f96 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for user 980ab18eb5c646378d738079621a0dbc and project c4914faafb494e5bb323114853f25c54. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:54:11.940656 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b532e946-c82c-42ac-8138-cc4777119f96 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059572 Aug 31 09:54:11.941410 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 356/702] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:54:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:54:11.950854 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] validate_networks() for [('c93cbb45-31b4-4c55-8a58-3426eb15ee6e', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:54:13.096086 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:54:13.096773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:54:13.101962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:54:13.101962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:54:13.101962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:54:13.120545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:13.121079 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:13.121532 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:13.129213 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:13.129709 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:13.130148 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:13.175658 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Getting quotas for project 9f1c2adbca494a53a24033b674c2762c. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:54:13.181555 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Getting quotas for user 893e06c5ea99497fae2847399b7a1a3c and project 9f1c2adbca494a53a24033b674c2762c. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:54:13.285602 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:54:13.291472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fe13405-4e50-4276-bae1-ea37fbb78f22',volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:54:13.447851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3ab58454-272a-4c31-aa79-4071e131ed2e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.728935 Aug 31 09:54:13.448601 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 347/703] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:54:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:54:13.461493 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-32a13353-2c9c-483a-aba8-eefdff17a17d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:13.462335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-32a13353-2c9c-483a-aba8-eefdff17a17d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:13.472243 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:13.529667 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-32a13353-2c9c-483a-aba8-eefdff17a17d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:13.539945 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-32a13353-2c9c-483a-aba8-eefdff17a17d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1094 microversion: 2.1 time: 0.083875 Aug 31 09:54:13.543734 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 357/704] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:13 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:14.257515 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1324642778", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5fb2c2c-d2a5-4039-a42c-96d968ac091e"}], "security_groups": [{"name": "tempest-securitygroup--633991171"}], "key_name": "tempest-keypair-812361715", "user_data": "}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:14.385427 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] validate_networks() for [('c5fb2c2c-d2a5-4039-a42c-96d968ac091e', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:54:14.560528 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:14.561300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:14.567983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:14.568478 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:14.568907 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:14.570150 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:14.570614 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:14.571029 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:14.642328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:14.652733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d1853851-18c1-4d9b-810b-6f0e2b1c1b70 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1192 microversion: 2.1 time: 0.096120 Aug 31 09:54:14.667275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 358/705] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:14 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1192 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:14.839467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:54:14.840225 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:54:14.840878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:54:14.841469 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:54:14.842229 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:54:14.856579 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:14.857091 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:14.857512 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:14.858338 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:14.858801 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:14.859262 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:14.873698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:14.880390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for project c4914faafb494e5bb323114853f25c54. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:54:14.885869 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Getting quotas for user 980ab18eb5c646378d738079621a0dbc and project c4914faafb494e5bb323114853f25c54. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:54:14.900848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:54:14.903159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:54:14.961249 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9dcd9734-793a-4ac0-9a55-9dfd8e0c7a00 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.708061 Aug 31 09:54:14.967277 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 348/706] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:54:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:54:14.973968 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-47ddecdc-c134-491e-a486-bf7d58027a24 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:14.974571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-47ddecdc-c134-491e-a486-bf7d58027a24 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:15.049545 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-47ddecdc-c134-491e-a486-bf7d58027a24 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:15.057239 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-47ddecdc-c134-491e-a486-bf7d58027a24 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1241 microversion: 2.1 time: 0.086994 Aug 31 09:54:15.058824 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 359/707] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:14 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:15.678667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:15.679833 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:15.686985 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:15.687933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:15.688481 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:15.689446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:15.690353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:15.690994 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:15.985738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:16.012235 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-50aedc5e-759e-4669-aab7-5045310274e6 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1277 microversion: 2.1 time: 0.339965 Aug 31 09:54:16.012854 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 349/708] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:15 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1277 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:16.081425 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:16.082642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:16.101976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:16.102772 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:16.104327 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:16.105835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:16.106557 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:16.108503 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:16.184060 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:16.192004 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8209136b-3e8d-491c-87b2-16bc49a88a6d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1293 microversion: 2.1 time: 0.114325 Aug 31 09:54:16.193493 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 360/709] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:16 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:16.722436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-b50845e2-a5cf-4760-a4dd-efeaa1374735 req-40ef6529-9628-4e0f-9667-56e007ad31dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ac26dc-0a69-4f0d-9d00-5f35ddc03871", "tag": "4bc08194-a758-4e1a-9082-fc97cf1c95fb"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:16.738142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-b50845e2-a5cf-4760-a4dd-efeaa1374735 req-40ef6529-9628-4e0f-9667-56e007ad31dc service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:16.738732 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-b50845e2-a5cf-4760-a4dd-efeaa1374735 req-40ef6529-9628-4e0f-9667-56e007ad31dc service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:16.739300 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-b50845e2-a5cf-4760-a4dd-efeaa1374735 req-40ef6529-9628-4e0f-9667-56e007ad31dc service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:16.753512 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-b50845e2-a5cf-4760-a4dd-efeaa1374735 req-40ef6529-9628-4e0f-9667-56e007ad31dc service nova] Creating event network-changed:4bc08194-a758-4e1a-9082-fc97cf1c95fb for instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 on hv-cinder-83754 Aug 31 09:54:16.759595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-b50845e2-a5cf-4760-a4dd-efeaa1374735 req-40ef6529-9628-4e0f-9667-56e007ad31dc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046628 Aug 31 09:54:16.760214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 350/710] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:17.033661 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:17.034679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:17.041642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:17.042186 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:17.042611 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:17.043338 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:17.043788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:17.044214 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:17.221694 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:17.225028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:17.238990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:17.239526 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:17.240165 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:17.242026 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:17.242501 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:17.243341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:17.270033 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:17.280896 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3eb851d6-3a61-4aca-9c04-feddeacd43ed tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.251022 Aug 31 09:54:17.282594 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 361/711] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:17 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:17.329509 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:17.337421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1dd6bbed-07f9-447b-b4a3-a7bfcebfaaed tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1299 microversion: 2.1 time: 0.124434 Aug 31 09:54:17.338220 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 351/712] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:17 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1299 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:18.302117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:18.303402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:18.310678 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:18.311201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:18.311640 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:18.312372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:18.312825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:18.313248 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:18.361875 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:18.362689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:18.372503 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:18.373151 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:18.373753 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:18.375267 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:18.376019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:18.376549 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:18.472556 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:18.480852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-31696b13-f6dd-4bf0-83e6-246ba33a14a5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.182611 Aug 31 09:54:18.494533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 362/713] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:18 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:18.745631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:18.761038 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e31fc027-5636-4c4d-abe6-871547f14e39 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1366 microversion: 2.1 time: 0.404837 Aug 31 09:54:18.762805 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 352/714] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:18 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:19.351293 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-c00317a3-03bf-48a4-a985-7319932faa63 req-250c8654-5ae3-439e-a84e-903391a327a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16f723b-daa7-4873-9171-c4cc20ba31f4", "tag": "9f90497f-7f0b-4b71-af6c-899933f8c225"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:19.362342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-c00317a3-03bf-48a4-a985-7319932faa63 req-250c8654-5ae3-439e-a84e-903391a327a5 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:19.362961 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-c00317a3-03bf-48a4-a985-7319932faa63 req-250c8654-5ae3-439e-a84e-903391a327a5 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:19.363720 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-c00317a3-03bf-48a4-a985-7319932faa63 req-250c8654-5ae3-439e-a84e-903391a327a5 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:19.378555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-c00317a3-03bf-48a4-a985-7319932faa63 req-250c8654-5ae3-439e-a84e-903391a327a5 service nova] Creating event network-changed:9f90497f-7f0b-4b71-af6c-899933f8c225 for instance b16f723b-daa7-4873-9171-c4cc20ba31f4 on hv-cinder-83754 Aug 31 09:54:19.384251 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-c00317a3-03bf-48a4-a985-7319932faa63 req-250c8654-5ae3-439e-a84e-903391a327a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037266 Aug 31 09:54:19.384859 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 363/715] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:19.505946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:19.506835 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:19.513935 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:19.514405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:19.514850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:19.515632 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:19.516094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:19.516518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:19.754631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:19.763154 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fece27c3-a0ba-41a9-9551-434897528d0e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.261216 Aug 31 09:54:19.763743 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 353/716] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:19 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:19.796544 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:19.797768 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:19.804447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:19.804944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:19.805338 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:19.806032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:19.806473 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:19.806889 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:19.951854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:19.960538 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5bea930d-8769-4c04-abfa-e31c43602d9f tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1366 microversion: 2.1 time: 0.169457 Aug 31 09:54:19.961137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 364/717] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:19 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:20.783999 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:20.784614 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:20.791800 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:20.792291 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:20.792734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:20.793467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:20.793923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:20.794352 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:20.981929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:20.983186 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:20.990264 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:20.990932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:20.992189 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:20.993110 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:20.993722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:20.994330 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:21.014638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:21.022242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:21.030170 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ce65e0f2-633a-4cd8-8d79-7fa50d3d0b9f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.249836 Aug 31 09:54:21.043345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 354/718] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:20 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:21.190501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:21.210308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2ccb2b11-b759-45c3-8f98-a52f4c4581c4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1366 microversion: 2.1 time: 0.231802 Aug 31 09:54:21.213568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 365/719] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:20 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:22.051402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:22.052247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:22.058992 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.059520 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.059962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.060666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.061125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.061548 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.208728 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:22.216826 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3a7379a5-c349-447e-af21-e65ed9477ed1 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.169201 Aug 31 09:54:22.217408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 355/720] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:22 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:22.235475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:22.236088 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:22.243523 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.244011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.244445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.245151 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:22.245723 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:22.246321 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:22.450764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:22.459103 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0417b51d-20f5-4caa-97ef-119cc54604fc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1366 microversion: 2.1 time: 0.227422 Aug 31 09:54:22.463219 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 366/721] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:22 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:23.244336 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:23.244336 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:23.255233 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:23.256115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:23.256907 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:23.258263 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:23.259089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:23.259947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:23.429462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:23.440041 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0227d83b-47d9-4175-bdda-346b13c12708 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.202119 Aug 31 09:54:23.454081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 356/722] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:23 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:23.481260 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:23.481972 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:23.489277 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:23.489739 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:23.490176 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:23.491156 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:23.491732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:23.492187 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:23.921092 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:23.931609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b329c52a-9ec5-4275-a425-7be9bb6ca1d0 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1366 microversion: 2.1 time: 0.454157 Aug 31 09:54:23.932574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 367/723] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:23 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:24.051857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-6e8c6946-a885-4a68-a800-e6f52f7e54d0 req-edfe80bf-d35c-4e04-8c29-95b76d74b9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16f723b-daa7-4873-9171-c4cc20ba31f4", "name": "network-vif-plugged", "status": "completed", "tag": "9f90497f-7f0b-4b71-af6c-899933f8c225"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:24.064235 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-6e8c6946-a885-4a68-a800-e6f52f7e54d0 req-edfe80bf-d35c-4e04-8c29-95b76d74b9ff service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.064981 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-6e8c6946-a885-4a68-a800-e6f52f7e54d0 req-edfe80bf-d35c-4e04-8c29-95b76d74b9ff service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.065776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-6e8c6946-a885-4a68-a800-e6f52f7e54d0 req-edfe80bf-d35c-4e04-8c29-95b76d74b9ff service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.081142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-6e8c6946-a885-4a68-a800-e6f52f7e54d0 req-edfe80bf-d35c-4e04-8c29-95b76d74b9ff service nova] Creating event network-vif-plugged:9f90497f-7f0b-4b71-af6c-899933f8c225 for instance b16f723b-daa7-4873-9171-c4cc20ba31f4 on hv-cinder-83754 Aug 31 09:54:24.085701 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-6e8c6946-a885-4a68-a800-e6f52f7e54d0 req-edfe80bf-d35c-4e04-8c29-95b76d74b9ff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037953 Aug 31 09:54:24.086689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 357/724] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:54:24.462750 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:24.463495 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:24.469425 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.469904 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.470328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.471518 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.471518 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.471893 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.683774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:24.692201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1546762a-a8ce-4377-9a41-2bc34ac3e07e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.234106 Aug 31 09:54:24.692804 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 368/725] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:24 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:24.955791 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=4 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:24.956751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=12 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:24.961261 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:24.961969 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:24.969058 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.969543 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.969976 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:24.970750 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:24.971153 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:24.971570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:25.124048 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:25.138693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bf52c8c4-dcb6-45f7-9d17-116939e20bbc tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1366 microversion: 2.1 time: 0.184407 Aug 31 09:54:25.139317 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 358/726] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:24 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:25.713806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:25.714436 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:25.716313 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=8 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:25.722333 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:25.722842 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:25.723287 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:25.723987 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:25.724444 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:25.724869 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:25.869452 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:25.879087 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-47b8e6e1-a28e-4bc9-bafb-bfd14b4454ef tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.168823 Aug 31 09:54:25.880351 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 369/727] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:25 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:26.161402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:26.162102 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:26.168771 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:26.169266 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:26.169699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:26.170395 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:26.170853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:26.171337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:26.329996 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:26.340959 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-dbb410b4-aa02-4cb3-9403-f5b9b5b637cb tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1366 microversion: 2.1 time: 0.183990 Aug 31 09:54:26.341541 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 359/728] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:26 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:26.646222 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d00d7fe6-d793-4811-93f9-0a93577f1648 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:26.646722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d00d7fe6-d793-4811-93f9-0a93577f1648 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:26.653611 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d00d7fe6-d793-4811-93f9-0a93577f1648 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:26.654099 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d00d7fe6-d793-4811-93f9-0a93577f1648 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:26.654528 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d00d7fe6-d793-4811-93f9-0a93577f1648 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:26.655467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d00d7fe6-d793-4811-93f9-0a93577f1648 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:26.655922 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d00d7fe6-d793-4811-93f9-0a93577f1648 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:26.656346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d00d7fe6-d793-4811-93f9-0a93577f1648 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:26.682598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d00d7fe6-d793-4811-93f9-0a93577f1648 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/ips" status: 200 len: 144 microversion: 2.1 time: 0.040306 Aug 31 09:54:26.684138 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 370/729] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:54:26 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:26.900187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:26.901015 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:26.907625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:26.908161 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:26.908866 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:26.909809 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:26.910319 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:26.910764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:27.051162 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:27.059882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5c8dfdf0-86c8-4e6f-bd83-a18d55aaa712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.164209 Aug 31 09:54:27.060415 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 360/730] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:26 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:27.361868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:27.362475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:27.369576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:27.370060 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:27.370489 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:27.371235 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:27.371693 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:27.372374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:27.515258 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:27.525507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-961b799b-6926-4dab-9890-6901ac035e7a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1556 microversion: 2.1 time: 0.166273 Aug 31 09:54:27.526101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 371/731] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:27 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:27.546434 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0f584360-ee9e-4cac-936e-61cd0e69fe2b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:27.546982 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0f584360-ee9e-4cac-936e-61cd0e69fe2b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:27.554030 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f584360-ee9e-4cac-936e-61cd0e69fe2b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:27.554450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f584360-ee9e-4cac-936e-61cd0e69fe2b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:27.554896 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f584360-ee9e-4cac-936e-61cd0e69fe2b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:27.555723 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f584360-ee9e-4cac-936e-61cd0e69fe2b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:27.556182 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f584360-ee9e-4cac-936e-61cd0e69fe2b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:27.556630 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0f584360-ee9e-4cac-936e-61cd0e69fe2b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:27.640774 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0f584360-ee9e-4cac-936e-61cd0e69fe2b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098270 Aug 31 09:54:27.641368 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 361/732] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Aug 31 09:54:27 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:28.083949 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:28.084695 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:28.093206 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.093702 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.094137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.094849 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.102321 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.103027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.252302 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-f4b3d0c4-0c18-42c8-a3ea-1a6cfb979141 req-b3847831-bcb6-4818-8339-7f1eba0c6642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ac26dc-0a69-4f0d-9d00-5f35ddc03871", "name": "network-vif-plugged", "status": "completed", "tag": "4bc08194-a758-4e1a-9082-fc97cf1c95fb"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:28.264866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-f4b3d0c4-0c18-42c8-a3ea-1a6cfb979141 req-b3847831-bcb6-4818-8339-7f1eba0c6642 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.265613 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-f4b3d0c4-0c18-42c8-a3ea-1a6cfb979141 req-b3847831-bcb6-4818-8339-7f1eba0c6642 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.266216 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-f4b3d0c4-0c18-42c8-a3ea-1a6cfb979141 req-b3847831-bcb6-4818-8339-7f1eba0c6642 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.273335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:28.279016 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-f4b3d0c4-0c18-42c8-a3ea-1a6cfb979141 req-b3847831-bcb6-4818-8339-7f1eba0c6642 service nova] Creating event network-vif-plugged:4bc08194-a758-4e1a-9082-fc97cf1c95fb for instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 on hv-cinder-83754 Aug 31 09:54:28.283289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f0caf8b2-3685-4d8c-a4c2-23534fe50d9b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.204876 Aug 31 09:54:28.284390 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-f4b3d0c4-0c18-42c8-a3ea-1a6cfb979141 req-b3847831-bcb6-4818-8339-7f1eba0c6642 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258813 Aug 31 09:54:28.284845 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 362/733] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:28 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:28.290261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 372/734] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:28.295612 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0ef91190-f5a8-4587-b29b-dbbf648b1c80 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efd72d96-1c82-40e5-9988-7f096bc38ea0"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:28.301252 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0ef91190-f5a8-4587-b29b-dbbf648b1c80 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:28.313529 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ef91190-f5a8-4587-b29b-dbbf648b1c80 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.314571 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ef91190-f5a8-4587-b29b-dbbf648b1c80 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.315439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ef91190-f5a8-4587-b29b-dbbf648b1c80 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.316246 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ef91190-f5a8-4587-b29b-dbbf648b1c80 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.316787 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ef91190-f5a8-4587-b29b-dbbf648b1c80 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.317296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0ef91190-f5a8-4587-b29b-dbbf648b1c80 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.672146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0ef91190-f5a8-4587-b29b-dbbf648b1c80 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385401 Aug 31 09:54:28.677978 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 363/735] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:54:28 2022] POST /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:28.849861 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-f395af42-8a08-4193-9850-0c96b7788714 req-6c320205-a4ea-4b15-ab56-ea71b65cb3eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16f723b-daa7-4873-9171-c4cc20ba31f4", "tag": "9f90497f-7f0b-4b71-af6c-899933f8c225"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:28.861058 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-f395af42-8a08-4193-9850-0c96b7788714 req-6c320205-a4ea-4b15-ab56-ea71b65cb3eb service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:28.861542 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-f395af42-8a08-4193-9850-0c96b7788714 req-6c320205-a4ea-4b15-ab56-ea71b65cb3eb service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:28.861971 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-f395af42-8a08-4193-9850-0c96b7788714 req-6c320205-a4ea-4b15-ab56-ea71b65cb3eb service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:28.874739 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-f395af42-8a08-4193-9850-0c96b7788714 req-6c320205-a4ea-4b15-ab56-ea71b65cb3eb service nova] Creating event network-changed:9f90497f-7f0b-4b71-af6c-899933f8c225 for instance b16f723b-daa7-4873-9171-c4cc20ba31f4 on hv-cinder-83754 Aug 31 09:54:28.879869 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-f395af42-8a08-4193-9850-0c96b7788714 req-6c320205-a4ea-4b15-ab56-ea71b65cb3eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090236 Aug 31 09:54:28.880654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 373/736] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:29.306042 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:29.306835 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:29.313064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:29.313550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:29.313992 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:29.314699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:29.315221 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:29.315607 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:29.653968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:29.666569 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3eb8518d-eb99-4a85-a90f-1e487fd0dc2b tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1265 microversion: 2.1 time: 0.364946 Aug 31 09:54:29.667690 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 364/737] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:29 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1265 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:30.690510 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:30.691236 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:30.698288 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.698772 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.699250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:30.699934 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.700380 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.700800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:30.861634 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:30.874651 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d4d034ae-46f3-4d7b-bfd5-d1ae8c360849 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1453 microversion: 2.1 time: 0.188795 Aug 31 09:54:30.883524 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 374/738] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:30 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:30.897211 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:30.898385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:30.906900 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.907426 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.907872 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:30.908660 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:30.909127 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:30.909557 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:30.914249 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:31.086000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:31.094340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9ad32996-4bfb-4b31-997e-63bd9d457787 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1453 microversion: 2.1 time: 0.201913 Aug 31 09:54:31.094946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 365/739] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:30 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1453 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:33.102349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-1e0e7c24-1082-4b4b-b3be-997947aab34a req-127dcff4-1df5-4386-b384-543c04432b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ac26dc-0a69-4f0d-9d00-5f35ddc03871", "tag": "4bc08194-a758-4e1a-9082-fc97cf1c95fb"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:33.118024 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-1e0e7c24-1082-4b4b-b3be-997947aab34a req-127dcff4-1df5-4386-b384-543c04432b86 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:33.118735 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-1e0e7c24-1082-4b4b-b3be-997947aab34a req-127dcff4-1df5-4386-b384-543c04432b86 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:33.119366 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-1e0e7c24-1082-4b4b-b3be-997947aab34a req-127dcff4-1df5-4386-b384-543c04432b86 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:33.138014 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-1e0e7c24-1082-4b4b-b3be-997947aab34a req-127dcff4-1df5-4386-b384-543c04432b86 service nova] Creating event network-changed:4bc08194-a758-4e1a-9082-fc97cf1c95fb for instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 on hv-cinder-83754 Aug 31 09:54:33.146622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-1e0e7c24-1082-4b4b-b3be-997947aab34a req-127dcff4-1df5-4386-b384-543c04432b86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049615 Aug 31 09:54:33.147785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 375/740] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:37.376526 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-83d69ad4-483d-4620-8200-255f6d4eb7f7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:37.378774 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-83d69ad4-483d-4620-8200-255f6d4eb7f7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:37.388543 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-83d69ad4-483d-4620-8200-255f6d4eb7f7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:37.389103 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-83d69ad4-483d-4620-8200-255f6d4eb7f7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:37.389902 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-83d69ad4-483d-4620-8200-255f6d4eb7f7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:37.390696 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-83d69ad4-483d-4620-8200-255f6d4eb7f7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:37.391233 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-83d69ad4-483d-4620-8200-255f6d4eb7f7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:37.391654 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-83d69ad4-483d-4620-8200-255f6d4eb7f7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:37.423484 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-83d69ad4-483d-4620-8200-255f6d4eb7f7 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050729 Aug 31 09:54:37.424165 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 366/741] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:54:37 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:37.444481 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9014c4dc-c866-4ce0-a92c-f59c43417d1b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:37.445192 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9014c4dc-c866-4ce0-a92c-f59c43417d1b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:37.451865 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9014c4dc-c866-4ce0-a92c-f59c43417d1b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:37.452382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9014c4dc-c866-4ce0-a92c-f59c43417d1b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:37.452837 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9014c4dc-c866-4ce0-a92c-f59c43417d1b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:37.453529 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9014c4dc-c866-4ce0-a92c-f59c43417d1b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:37.453974 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9014c4dc-c866-4ce0-a92c-f59c43417d1b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:37.454389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9014c4dc-c866-4ce0-a92c-f59c43417d1b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:37.485693 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9014c4dc-c866-4ce0-a92c-f59c43417d1b tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/efd72d96-1c82-40e5-9988-7f096bc38ea0" status: 200 len: 194 microversion: 2.1 time: 0.053911 Aug 31 09:54:37.486284 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 376/742] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Aug 31 09:54:37 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/efd72d96-1c82-40e5-9988-7f096bc38ea0 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:38.851355 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-cc238cc1-e74a-4d6a-a943-98530020a74c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e6098d7-f74b-4a41-b3f0-dd4cbfc1fd89"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:38.853819 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-cc238cc1-e74a-4d6a-a943-98530020a74c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:38.860430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cc238cc1-e74a-4d6a-a943-98530020a74c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:38.860921 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cc238cc1-e74a-4d6a-a943-98530020a74c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:38.861360 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cc238cc1-e74a-4d6a-a943-98530020a74c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:38.862066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cc238cc1-e74a-4d6a-a943-98530020a74c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:38.862533 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cc238cc1-e74a-4d6a-a943-98530020a74c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:38.862962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cc238cc1-e74a-4d6a-a943-98530020a74c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:39.196296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-cc238cc1-e74a-4d6a-a943-98530020a74c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "POST /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349998 Aug 31 09:54:39.198589 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 367/743] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:54:38 2022] POST /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:40.652000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-539854855", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "networks": [{"uuid": "e7620f1e-3578-483f-aef8-7dce20d65c2f"}]}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:40.709139 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.network.neutron [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] validate_networks() for [('e7620f1e-3578-483f-aef8-7dce20d65c2f', None, None, None, None, None)] {{(pid=132570) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:54:41.114816 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Flavor limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:54:41.115279 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Image limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:54:41.116372 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Flavor pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:54:41.116786 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Image pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:54:41.117200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:54:41.126215 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:41.126697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:41.127144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:41.127874 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:41.128326 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:41.128749 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:41.145373 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Getting quotas for project 7713ff3ccc8546b68a89f2e2087d5abf. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:54:41.151066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Getting quotas for user 1530c2946ff3486daf7c8b2b70c1a3b6 and project 7713ff3ccc8546b68a89f2e2087d5abf. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:54:41.162013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Going to run 1 instances... {{(pid=132570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:54:41.164985 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:54:41.210563 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-830dd0d1-4e91-4274-8dd7-f1cc6681392c tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563157 Aug 31 09:54:41.211234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 377/744] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:54:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:54:41.222536 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6c68002c-0d06-4096-8ee6-75d347267475 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:41.223268 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6c68002c-0d06-4096-8ee6-75d347267475 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:41.279446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-6c68002c-0d06-4096-8ee6-75d347267475 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:41.286293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6c68002c-0d06-4096-8ee6-75d347267475 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1213 microversion: 2.1 time: 0.067981 Aug 31 09:54:41.286865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 368/745] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:41 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:42.309393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:42.309962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:42.316308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:42.316791 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:42.317219 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:42.317950 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:42.318558 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:42.319901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:42.389438 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:42.398795 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d9fd2956-f11b-493d-81a0-2ff6731c3548 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1265 microversion: 2.1 time: 0.093520 Aug 31 09:54:42.399709 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 378/746] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:42 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:43.422107 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:43.423381 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:43.431607 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:43.432095 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:43.432533 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:43.433243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:43.433699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:43.434124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:43.640220 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:43.648021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ff5c2e6a-f27d-45d9-b845-4b67dfa0f8f1 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1313 microversion: 2.1 time: 0.230680 Aug 31 09:54:43.648697 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 369/747] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:43 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:44.232134 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4796af39-f89f-4f77-94b5-c377e9b0c3d4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:44.232675 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4796af39-f89f-4f77-94b5-c377e9b0c3d4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:44.235269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:44.241014 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-60ca9257-ba05-449d-b2cc-f489a26ca5ea req-3485a9cd-9c4d-4903-81b7-e398e0a51d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce1032d-7d0b-4fba-aebb-05e022f18522", "tag": "c379a819-5e30-45b5-a80b-17c29525f450"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:44.246976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4796af39-f89f-4f77-94b5-c377e9b0c3d4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:44.247754 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4796af39-f89f-4f77-94b5-c377e9b0c3d4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:44.248541 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4796af39-f89f-4f77-94b5-c377e9b0c3d4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:44.249095 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4796af39-f89f-4f77-94b5-c377e9b0c3d4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:44.249730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4796af39-f89f-4f77-94b5-c377e9b0c3d4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:44.250307 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4796af39-f89f-4f77-94b5-c377e9b0c3d4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:44.252629 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-60ca9257-ba05-449d-b2cc-f489a26ca5ea req-3485a9cd-9c4d-4903-81b7-e398e0a51d64 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:44.253474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-60ca9257-ba05-449d-b2cc-f489a26ca5ea req-3485a9cd-9c4d-4903-81b7-e398e0a51d64 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:44.254097 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-60ca9257-ba05-449d-b2cc-f489a26ca5ea req-3485a9cd-9c4d-4903-81b7-e398e0a51d64 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:44.268625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-60ca9257-ba05-449d-b2cc-f489a26ca5ea req-3485a9cd-9c4d-4903-81b7-e398e0a51d64 service nova] Creating event network-changed:c379a819-5e30-45b5-a80b-17c29525f450 for instance 7ce1032d-7d0b-4fba-aebb-05e022f18522 on hv-cinder-83754 Aug 31 09:54:44.279766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-60ca9257-ba05-449d-b2cc-f489a26ca5ea req-3485a9cd-9c4d-4903-81b7-e398e0a51d64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043097 Aug 31 09:54:44.282505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 370/748] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:54:44.293374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4796af39-f89f-4f77-94b5-c377e9b0c3d4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/ips" status: 200 len: 151 microversion: 2.20 time: 0.065421 Aug 31 09:54:44.294741 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 379/749] 10.222.0.36 () {60 vars in 1289 bytes} [Wed Aug 31 09:54:44 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/ips => generated 151 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:54:44.670423 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:44.671811 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:44.677461 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:44.678112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:44.679371 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:44.680199 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:44.680709 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:44.681264 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:44.849110 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:44.857168 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c0e97d97-8497-49c4-a8ed-e7193f39138e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1313 microversion: 2.1 time: 0.191006 Aug 31 09:54:44.857742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 371/750] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:44 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:45.878299 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:45.878846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:45.885288 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:45.885777 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:45.886214 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:45.886905 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:45.887505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:45.887938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:46.025751 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:46.033391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-16750eee-90f0-4baf-b0d7-5a3b1ab4b235 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1313 microversion: 2.1 time: 0.159041 Aug 31 09:54:46.033963 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 380/751] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:45 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:46.210798 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:46.211432 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:46.213808 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:46.219627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:46.220114 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:46.220557 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:46.221255 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:46.221720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:46.222146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:46.247838 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lazy-loading 'flavor' on Instance uuid cb2a31fa-a87b-468d-8e3b-5065c7b93903 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:46.439541 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0e52de1f-76d3-47bf-875a-d9679db28cd5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/action" status: 202 len: 0 microversion: 2.20 time: 0.233196 Aug 31 09:54:46.440238 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 372/752] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Aug 31 09:54:46 2022] POST /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:54:46.448827 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:46.449434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:46.455843 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:46.456329 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:46.456761 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:46.457448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:46.457909 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:46.458355 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:46.608781 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:46.619116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:46.621318 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:46.622806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c66db50c-aa6d-4f5e-825d-03e66248afa8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.177837 Aug 31 09:54:46.623760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 381/753] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:46 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:54:47.056634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:47.057350 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:47.063686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.064172 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.064608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:47.065304 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.065759 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.066185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:47.273163 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:47.281070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4061d7ce-8d10-4375-b46f-83b9cf3025c3 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1313 microversion: 2.1 time: 0.229234 Aug 31 09:54:47.281653 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 373/754] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:47 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:47.647009 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:47.648393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:47.654696 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.655195 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.655633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:47.656312 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.656757 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.657176 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:47.800249 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:47.809308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:47.810746 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:47.811939 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7836ced2-c061-498e-ad31-e3b6e504049e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.168921 Aug 31 09:54:47.814504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 382/755] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:47 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:54:47.831362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2e98b484-3b1d-40bf-b24e-932e6cbd1512 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:47.833550 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2e98b484-3b1d-40bf-b24e-932e6cbd1512 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:47.840098 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e98b484-3b1d-40bf-b24e-932e6cbd1512 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.840590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e98b484-3b1d-40bf-b24e-932e6cbd1512 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.841022 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e98b484-3b1d-40bf-b24e-932e6cbd1512 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:47.841764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e98b484-3b1d-40bf-b24e-932e6cbd1512 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.842221 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e98b484-3b1d-40bf-b24e-932e6cbd1512 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.842640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e98b484-3b1d-40bf-b24e-932e6cbd1512 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:47.875027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2e98b484-3b1d-40bf-b24e-932e6cbd1512 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047552 Aug 31 09:54:47.875640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 374/756] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:54:47 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:47.986598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-37bc012f-c7e0-4e34-ba09-f934b81df745 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:47.987392 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-37bc012f-c7e0-4e34-ba09-f934b81df745 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:47.993505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-37bc012f-c7e0-4e34-ba09-f934b81df745 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.994012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-37bc012f-c7e0-4e34-ba09-f934b81df745 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.994445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-37bc012f-c7e0-4e34-ba09-f934b81df745 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:47.995598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-37bc012f-c7e0-4e34-ba09-f934b81df745 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:47.996135 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-37bc012f-c7e0-4e34-ba09-f934b81df745 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:47.996558 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-37bc012f-c7e0-4e34-ba09-f934b81df745 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:48.027469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-37bc012f-c7e0-4e34-ba09-f934b81df745 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/efd72d96-1c82-40e5-9988-7f096bc38ea0" status: 200 len: 194 microversion: 2.1 time: 0.045231 Aug 31 09:54:48.028069 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 383/757] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Aug 31 09:54:47 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/efd72d96-1c82-40e5-9988-7f096bc38ea0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:48.039295 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:48.039806 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:48.045784 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:48.046271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:48.046705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:48.047428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:48.048084 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:48.048509 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:48.074386 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-030c0bee-442c-48d6-a4cc-aa43412b881c req-4112f719-25ef-431b-8d07-0924bd0a2285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce1032d-7d0b-4fba-aebb-05e022f18522", "name": "network-vif-plugged", "status": "completed", "tag": "c379a819-5e30-45b5-a80b-17c29525f450"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:48.089684 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-030c0bee-442c-48d6-a4cc-aa43412b881c req-4112f719-25ef-431b-8d07-0924bd0a2285 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:48.090252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-030c0bee-442c-48d6-a4cc-aa43412b881c req-4112f719-25ef-431b-8d07-0924bd0a2285 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:48.091540 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-030c0bee-442c-48d6-a4cc-aa43412b881c req-4112f719-25ef-431b-8d07-0924bd0a2285 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:48.105234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-030c0bee-442c-48d6-a4cc-aa43412b881c req-4112f719-25ef-431b-8d07-0924bd0a2285 service nova] Creating event network-vif-plugged:c379a819-5e30-45b5-a80b-17c29525f450 for instance 7ce1032d-7d0b-4fba-aebb-05e022f18522 on hv-cinder-83754 Aug 31 09:54:48.110777 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-030c0bee-442c-48d6-a4cc-aa43412b881c req-4112f719-25ef-431b-8d07-0924bd0a2285 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041567 Aug 31 09:54:48.112193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 384/758] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:48.137904 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lazy-loading 'services' on Instance uuid 84e870ae-a12e-4bd7-b49f-1bc976ea7bac {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:48.218919 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1358509e-6108-482a-80e9-df7028adf3df tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/efd72d96-1c82-40e5-9988-7f096bc38ea0" status: 202 len: 0 microversion: 2.1 time: 0.184315 Aug 31 09:54:48.219759 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 375/759] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:54:48 2022] DELETE /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/efd72d96-1c82-40e5-9988-7f096bc38ea0 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:48.304865 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:48.305802 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:48.314026 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:48.314469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:48.315730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:48.316664 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:48.317191 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:48.317687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:48.472693 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:48.480504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0e9de6c9-4a56-451c-873f-d9c25f81ea61 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1313 microversion: 2.1 time: 0.181035 Aug 31 09:54:48.481066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 385/760] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:48 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:48.838537 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:48.839260 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:48.845488 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:48.845980 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:48.846419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:48.847137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:48.847600 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:48.848028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:48.986816 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:48.995271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:48.996979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:48.998158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-12ffa4f4-93d2-481c-b806-f4349a1ac444 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.164425 Aug 31 09:54:48.998724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 376/761] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:48 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:54:49.501400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:49.502007 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:49.509300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:49.509791 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:49.510233 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:49.510930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:49.511422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:49.511852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:49.515877 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:49.647539 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:49.655246 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-30967db6-22a3-49f3-a831-5b3eecda78ba tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1313 microversion: 2.1 time: 0.157689 Aug 31 09:54:49.655821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 386/762] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:49 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:50.021415 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:50.022187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:50.029248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.029722 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.030148 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.030833 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.031313 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.031732 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.166302 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:50.175064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:50.176513 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:50.177719 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3d6a0a27-ae95-4cba-9b6f-f9a10f90ab19 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.160170 Aug 31 09:54:50.178281 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 377/763] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:50 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:54:50.417051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4b8195ca-8c78-4d0f-81c1-36a1a13d7af6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:50.417467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4b8195ca-8c78-4d0f-81c1-36a1a13d7af6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:50.424228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b8195ca-8c78-4d0f-81c1-36a1a13d7af6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.424789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b8195ca-8c78-4d0f-81c1-36a1a13d7af6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.425273 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b8195ca-8c78-4d0f-81c1-36a1a13d7af6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.425915 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b8195ca-8c78-4d0f-81c1-36a1a13d7af6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.426362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b8195ca-8c78-4d0f-81c1-36a1a13d7af6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.426783 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4b8195ca-8c78-4d0f-81c1-36a1a13d7af6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.458445 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4b8195ca-8c78-4d0f-81c1-36a1a13d7af6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/4e6098d7-f74b-4a41-b3f0-dd4cbfc1fd89" status: 200 len: 194 microversion: 2.1 time: 0.046297 Aug 31 09:54:50.459037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 387/764] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Aug 31 09:54:50 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/4e6098d7-f74b-4a41-b3f0-dd4cbfc1fd89 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:54:50.469716 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:50.470207 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:50.476510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.477049 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.477490 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.478185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.478648 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.479067 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.561039 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lazy-loading 'services' on Instance uuid 84e870ae-a12e-4bd7-b49f-1bc976ea7bac {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:50.627480 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:50.638558 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1cc825fc-0ba0-44ec-8a60-6c439b0e5186 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/4e6098d7-f74b-4a41-b3f0-dd4cbfc1fd89" status: 202 len: 0 microversion: 2.1 time: 0.172672 Aug 31 09:54:50.639178 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 378/765] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:54:50 2022] DELETE /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments/4e6098d7-f74b-4a41-b3f0-dd4cbfc1fd89 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:50.677317 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:50.678234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:50.685463 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.685953 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.686390 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.687098 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:50.687579 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:50.688014 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:50.827305 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:50.835909 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-abe0bd91-1e35-419f-888c-31b352eaee24 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1498 microversion: 2.1 time: 0.162479 Aug 31 09:54:50.836510 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 388/766] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:50 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:51.202675 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:51.203385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:51.210205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:51.210677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:51.211102 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:51.211801 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:51.212247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:51.212662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:51.283644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:51.367772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:51.376688 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:51.378127 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:51.379339 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-24a71a60-e52c-4669-934a-54f82a6fb2cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.181868 Aug 31 09:54:51.379912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 379/767] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:51 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:54:51.429085 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:51.429638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:51.431362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:51.432019 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=6 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:51.437790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:51.438279 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:51.438715 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:51.439431 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:51.439891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:51.440315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:51.466373 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:54:51.543070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a26496f0-5c50-4e19-96ce-27d626f78f7d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 204 len: 0 microversion: 2.1 time: 0.117136 Aug 31 09:54:51.544673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 389/768] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:54:51 2022] DELETE /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:54:51.554712 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:51.555541 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:51.561829 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:51.562309 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:51.562736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:51.563455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:51.563904 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:51.564323 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:51.706690 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:51.714551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5012a7af-a486-40aa-873c-45215e9b30d8 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1504 microversion: 2.1 time: 0.165735 Aug 31 09:54:51.715217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 380/769] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:51 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:52.407282 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:52.408053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:52.416389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:52.416878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:52.417314 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:52.418010 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:52.418463 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:52.418886 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:52.574050 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:52.582705 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:52.584219 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:52.585916 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-62b7057c-6302-402b-a910-ec8f9f13e7b3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.185892 Aug 31 09:54:52.586487 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 390/770] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:52 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:54:52.735039 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:52.735687 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:52.742806 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:52.743332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:52.743772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:52.744466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:52.744947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:52.745350 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:52.881640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:52.889345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-354fd141-6b6c-4b98-aeee-b54646af2459 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1504 microversion: 2.1 time: 0.158314 Aug 31 09:54:52.889916 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 381/771] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:52 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:53.611162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:53.611769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:53.623422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.624902 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.625504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.626651 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.627804 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.628236 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.776530 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:53.786673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:53.789783 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:53.791105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-64c85daf-7a55-4ae6-ba2e-4047c197c7f9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.185112 Aug 31 09:54:53.791808 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 391/772] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:53 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:54:53.876775 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-05399a17-4e55-40e4-940f-44c0abd6a57b req-abc105a8-afe1-4da7-bd50-dc5723b0acae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce1032d-7d0b-4fba-aebb-05e022f18522", "name": "network-vif-deleted", "tag": "c379a819-5e30-45b5-a80b-17c29525f450"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:53.889627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-05399a17-4e55-40e4-940f-44c0abd6a57b req-abc105a8-afe1-4da7-bd50-dc5723b0acae service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.890202 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-05399a17-4e55-40e4-940f-44c0abd6a57b req-abc105a8-afe1-4da7-bd50-dc5723b0acae service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.891069 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-05399a17-4e55-40e4-940f-44c0abd6a57b req-abc105a8-afe1-4da7-bd50-dc5723b0acae service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.908640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-05399a17-4e55-40e4-940f-44c0abd6a57b req-abc105a8-afe1-4da7-bd50-dc5723b0acae service nova] Creating event network-vif-deleted:c379a819-5e30-45b5-a80b-17c29525f450 for instance 7ce1032d-7d0b-4fba-aebb-05e022f18522 on hv-cinder-83754 Aug 31 09:54:53.915321 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-05399a17-4e55-40e4-940f-44c0abd6a57b req-abc105a8-afe1-4da7-bd50-dc5723b0acae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042249 Aug 31 09:54:53.916044 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 382/773] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:53.921775 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:53.922002 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:53.939944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.940598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.941103 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.942301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.943841 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.945402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.962776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1c1b94a8-27b2-48dd-a7c4-34187ebc94f5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:53.965242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1c1b94a8-27b2-48dd-a7c4-34187ebc94f5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:53.974225 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1c1b94a8-27b2-48dd-a7c4-34187ebc94f5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.974825 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1c1b94a8-27b2-48dd-a7c4-34187ebc94f5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.976201 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1c1b94a8-27b2-48dd-a7c4-34187ebc94f5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:53.976995 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1c1b94a8-27b2-48dd-a7c4-34187ebc94f5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:53.977457 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1c1b94a8-27b2-48dd-a7c4-34187ebc94f5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:53.978137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1c1b94a8-27b2-48dd-a7c4-34187ebc94f5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.011636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1c1b94a8-27b2-48dd-a7c4-34187ebc94f5 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054051 Aug 31 09:54:54.012224 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 383/774] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:54:53 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 09:54:54.027732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:54.037346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-84bb0e9a-9a83-4021-b798-9219c8a5e24b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1298 microversion: 2.1 time: 0.123354 Aug 31 09:54:54.039146 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 392/775] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:53 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:54.169010 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-da552df7-ad5a-469d-b700-cacd06d7240f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:54.171441 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-da552df7-ad5a-469d-b700-cacd06d7240f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:54.177598 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da552df7-ad5a-469d-b700-cacd06d7240f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:54.178900 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da552df7-ad5a-469d-b700-cacd06d7240f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:54.179536 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da552df7-ad5a-469d-b700-cacd06d7240f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.180247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da552df7-ad5a-469d-b700-cacd06d7240f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:54.180710 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da552df7-ad5a-469d-b700-cacd06d7240f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:54.181137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-da552df7-ad5a-469d-b700-cacd06d7240f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.213611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-da552df7-ad5a-469d-b700-cacd06d7240f tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048456 Aug 31 09:54:54.214205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 384/776] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:54:54 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 09:54:54.281591 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:54.281999 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:54.288714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:54.289184 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:54.289615 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.290302 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:54.290751 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:54.291193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.320926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:54:54.401928 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2dea63ee-21d5-4f5e-9fa2-347dfe6811ec tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 204 len: 0 microversion: 2.1 time: 0.123847 Aug 31 09:54:54.402536 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 393/777] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:54:54 2022] DELETE /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:54:54.411450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:54.412361 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:54.419222 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:54.419715 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:54.420183 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.420886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:54.421342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:54.421768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.588435 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:54.597256 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d7dd776a-4f25-4f75-ade6-280125786931 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1671 microversion: 2.1 time: 0.189771 Aug 31 09:54:54.597842 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 385/778] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:54 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1671 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:54.816074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:54.816776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:54.823340 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:54.823847 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:54.824271 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.825024 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:54.825490 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:54.825947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:54.964508 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:54.972507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:54.973929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:54.975691 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-85a99719-bec8-4e4f-abed-2c14bc5613ce tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.163387 Aug 31 09:54:54.976535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 394/779] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:54 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:54:55.059790 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:55.060411 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:55.067064 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:55.067607 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:55.068040 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:55.069269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:55.069882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:55.070304 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:55.102227 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:55.102706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:55.103157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:55.103599 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lazy-loading 'fault' on Instance uuid 7ce1032d-7d0b-4fba-aebb-05e022f18522 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:55.148862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:55.156882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-856d5d30-a7d9-4b0b-a50b-66a70b143614 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1303 microversion: 2.1 time: 0.100914 Aug 31 09:54:55.157468 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 386/780] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:55 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:55.620368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:55.620972 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:55.627292 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:55.627782 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:55.628220 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:55.628925 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:55.629412 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:55.629886 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:55.770068 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:55.778712 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fba23e63-cd9a-4092-b494-659dbd29cfb6 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1671 microversion: 2.1 time: 0.162711 Aug 31 09:54:55.779394 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 395/781] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:55 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:55.998832 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:55.999480 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:56.005646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:56.006125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:56.007215 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:56.007911 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:56.008366 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:56.008824 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:56.141954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:56.149909 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:56.151296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:56.152442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-af660147-4f77-4c39-8488-edbb7c684253 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.157851 Aug 31 09:54:56.152997 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 387/782] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:55 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:54:56.177623 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:56.178903 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:56.186038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:56.186440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:56.186874 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:56.187601 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:56.188056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:56.188482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:56.219389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:56.219870 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:56.220303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:56.220744 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lazy-loading 'fault' on Instance uuid 7ce1032d-7d0b-4fba-aebb-05e022f18522 {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:54:56.261667 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:56.269634 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-211626db-a535-45fb-921c-635128a69c5e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 200 len: 1303 microversion: 2.1 time: 0.095773 Aug 31 09:54:56.270211 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 396/783] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:56 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:56.799990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:56.800598 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:56.807066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:56.807608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:56.808056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:56.808770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:56.809234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:56.809665 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:57.065556 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:57.080605 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-aaaad968-92fe-47e1-9092-3770ae0d2a68 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1671 microversion: 2.1 time: 0.283801 Aug 31 09:54:57.082782 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 388/784] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:56 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1671 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:57.175875 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:57.176634 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:57.184241 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:57.184931 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:57.185157 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:57.185863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:57.186341 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:57.186739 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:57.291403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:57.292031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 7ce1032d-7d0b-4fba-aebb-05e022f18522] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:57.298497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:57.298981 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:57.299630 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:57.300504 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:57.300963 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:57.301392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:57.316862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] HTTP exception thrown: Instance 7ce1032d-7d0b-4fba-aebb-05e022f18522 could not be found. Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Request method failure captured: Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 HTTP/1.1 Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy_eLXQdvrCd_mJecx5ba0bzFOL7zOR9pmnwN_76DioQvLB5JmjOePb5cWQqRtSA1dopg1AW-W4t7PoppmJfHrXodWPRYDJWT1zur08MDHZwsTYu4e-KQaisdGmkR9k65bBX_Xn-y9V7hKdjePWelQ8cwmx8l4q8mQzcZKI1_Bnou-o Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 7713ff3ccc8546b68a89f2e2087d5abf Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-VolumesActionsTest-918794272 Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:54:57.318551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7713ff3ccc8546b68a89f2e2087d5abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7713ff3ccc8546b68a89f2e2087d5abf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7713ff3ccc8546b68a89f2e2087d5abf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7713ff3ccc8546b68a89f2e2087d5abf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-VolumesActionsTest-918794272 Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 7713ff3ccc8546b68a89f2e2087d5abf Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-VolumesActionsTest-918794272 Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-VolumesActionsTest-918794272-project Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 1530c2946ff3486daf7c8b2b70c1a3b6 Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-VolumesActionsTest-918794272-project Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 7ce1032d-7d0b-4fba-aebb-05e022f18522 could not be found. Aug 31 09:54:57.320903 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '7ce1032d-7d0b-4fba-aebb-05e022f18522'} Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce1032d-7d0b-4fba-aebb-05e022f18522 could not be found. Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:54:57.321851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce1032d-7d0b-4fba-aebb-05e022f18522 could not be found. Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce1032d-7d0b-4fba-aebb-05e022f18522 could not be found. Aug 31 09:54:57.323274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:57.325389 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Returning 404 to user: Instance 7ce1032d-7d0b-4fba-aebb-05e022f18522 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:54:57.326269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-6d62f23f-1c15-412f-9a76-881eca2ff859 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522" status: 404 len: 111 microversion: 2.1 time: 0.039208 Aug 31 09:54:57.326841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 389/785] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:57 2022] GET /compute/v2.1/servers/7ce1032d-7d0b-4fba-aebb-05e022f18522 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:54:57.330127 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:57.344387 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:57.345982 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:57.347309 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e5bf4ca8-9081-4d3e-9a37-215695034a78 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.175248 Aug 31 09:54:57.349400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 397/786] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:57 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:54:57.379192 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1038403880", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "networks": [{"uuid": "e7620f1e-3578-483f-aef8-7dce20d65c2f"}]}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:57.439295 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] validate_networks() for [('e7620f1e-3578-483f-aef8-7dce20d65c2f', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:54:58.106826 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:58.107509 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:58.113898 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:58.114315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:58.114751 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:58.115511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:58.116371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:58.116793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:58.191037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ca4276e1554d4184451313b2e09a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568beb0822e640c1bacd98a2aec950ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:58.200356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-cee099dd-e016-40b9-88da-f1edb4fd3c8c tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 200 len: 1603 microversion: 2.1 time: 0.099742 Aug 31 09:54:58.201440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 398/787] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:58 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 1603 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:58.280294 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-72d4b598-584e-4c33-9827-9d798bb613f9 req-2e70953f-e306-469f-9688-c65a56ab23d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e870ae-a12e-4bd7-b49f-1bc976ea7bac", "name": "network-vif-deleted", "tag": "65d7a932-46a5-495d-b669-205bbdc7fb8c"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:54:58.294584 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-72d4b598-584e-4c33-9827-9d798bb613f9 req-2e70953f-e306-469f-9688-c65a56ab23d8 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:58.295071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-72d4b598-584e-4c33-9827-9d798bb613f9 req-2e70953f-e306-469f-9688-c65a56ab23d8 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:58.295532 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-72d4b598-584e-4c33-9827-9d798bb613f9 req-2e70953f-e306-469f-9688-c65a56ab23d8 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:58.300567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:58.310960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-72d4b598-584e-4c33-9827-9d798bb613f9 req-2e70953f-e306-469f-9688-c65a56ab23d8 service nova] Creating event network-vif-deleted:65d7a932-46a5-495d-b669-205bbdc7fb8c for instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac on hv-cinder-83754 Aug 31 09:54:58.318474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-72d4b598-584e-4c33-9827-9d798bb613f9 req-2e70953f-e306-469f-9688-c65a56ab23d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041774 Aug 31 09:54:58.320546 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 399/788] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:54:58.334105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:54:58.335651 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:54:58.335790 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:54:58.336321 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:54:58.336738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:54:58.349695 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:58.351111 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:58.351734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:58.352544 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:58.353008 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:58.353430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:58.375064 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:58.376045 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:58.376171 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Getting quotas for project 7713ff3ccc8546b68a89f2e2087d5abf. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:54:58.382525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Getting quotas for user 1530c2946ff3486daf7c8b2b70c1a3b6 and project 7713ff3ccc8546b68a89f2e2087d5abf. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:54:58.386868 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:58.387878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:58.388423 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:58.389746 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:58.390325 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:58.391523 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:58.396229 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:54:58.399010 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:54:58.469148 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e827f90e-1379-411b-be69-35fa158ad248 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093689 Aug 31 09:54:58.470031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 390/789] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:54:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:54:58.481827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-cc2aa91b-bdbc-465f-8c02-c5291e167fa6 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:58.483812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-cc2aa91b-bdbc-465f-8c02-c5291e167fa6 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:58.582384 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-cc2aa91b-bdbc-465f-8c02-c5291e167fa6 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:58.600632 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-cc2aa91b-bdbc-465f-8c02-c5291e167fa6 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1214 microversion: 2.1 time: 0.121926 Aug 31 09:54:58.603519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 391/790] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:58 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:54:58.613589 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:58.625464 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:58.629620 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:58.633085 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9562d2d2-3632-47ec-ae3d-c0a7c0ff861d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.263159 Aug 31 09:54:58.646901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 400/791] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:58 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:54:59.222968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:59.223610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:59.233518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:59.234025 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:59.234469 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:59.235340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:59.236053 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:59.236648 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:59.257606 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] HTTP exception thrown: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Request method failure captured: Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac HTTP/1.1 Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy52w6wfH72f-sK25qErzAxt5rKNtYL1ccvYgQXOwyNK3IszxP6Ypgk7xGLyJfX63IJBEzMSARXZJ12Nqql2LpFy_MbWuF8-0XO3V5kJOAUUD9GGIIxHhKfCa62NMP_rKzUAmX_EZlGHRsbCJmcCF7lmt96i9_bByD0nlZ_h4y1vmsM Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:54:59.259913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: b6ca4276e1554d4184451313b2e09a88 Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:54:59.261463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '84e870ae-a12e-4bd7-b49f-1bc976ea7bac'} Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:54:59.262341 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:54:59.263643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:54:59.264724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Returning 404 to user: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:54:59.264724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-70e90faa-434e-46b5-9a53-03b4a3af48fe tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 404 len: 111 microversion: 2.1 time: 0.043143 Aug 31 09:54:59.264724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 392/792] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:59 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:54:59.271652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-33ee4cf0-7365-460e-8165-af6acfe60742 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '.version_select at 0x7f9462963e50>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:59.299548 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-33ee4cf0-7365-460e-8165-af6acfe60742 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369977368" status: 202 len: 0 microversion: 2.1 time: 0.032082 Aug 31 09:54:59.300202 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 401/793] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Aug 31 09:54:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369977368 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:54:59.625312 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:59.625923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:59.633079 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:59.633599 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:59.634037 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:59.634878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:59.635513 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:59.635945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:59.660328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:54:59.661365 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:54:59.673565 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:59.674484 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:59.675014 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:59.676060 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:54:59.676643 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:54:59.677141 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:54:59.718356 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:59.726410 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e4aed362-5b21-44ce-9d44-13cf1eba64aa tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1266 microversion: 2.1 time: 0.105379 Aug 31 09:54:59.727537 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 393/794] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:54:59 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:54:59.883314 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:59.897975 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:59.900949 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:54:59.902150 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4867ef3f-ddfd-4d31-bbb0-4de9c6733d03 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.245893 Aug 31 09:54:59.902749 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 402/795] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:54:59 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:00.749362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:00.750104 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:00.757691 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:00.758382 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:00.758824 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:00.759572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:00.760030 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:00.760457 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:00.926522 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:00.927181 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:00.934686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:00.935263 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:00.935710 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:00.936422 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:00.936875 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:00.937300 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:00.987103 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:00.997678 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-988d94ba-9a66-48f3-8254-9549eba95d86 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1314 microversion: 2.1 time: 0.252331 Aug 31 09:55:00.998556 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 394/796] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:00 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:01.088218 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:01.096791 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:01.098383 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:01.099520 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-73125031-9ec6-4e6c-957c-80a317ed3c14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.177682 Aug 31 09:55:01.100957 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 403/797] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:00 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:01.392395 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-5b45ac64-d173-43b8-ba10-23682adcfa69 req-47abb3c2-4319-44f5-96c1-1a544f07e885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2697de38-560e-4039-a65c-87c255d6b842", "tag": "ef50d84a-a13e-4d5f-a106-25b190e343a6"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:01.403187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-5b45ac64-d173-43b8-ba10-23682adcfa69 req-47abb3c2-4319-44f5-96c1-1a544f07e885 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:01.403803 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-5b45ac64-d173-43b8-ba10-23682adcfa69 req-47abb3c2-4319-44f5-96c1-1a544f07e885 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:01.404396 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-5b45ac64-d173-43b8-ba10-23682adcfa69 req-47abb3c2-4319-44f5-96c1-1a544f07e885 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:01.417021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-5b45ac64-d173-43b8-ba10-23682adcfa69 req-47abb3c2-4319-44f5-96c1-1a544f07e885 service nova] Creating event network-changed:ef50d84a-a13e-4d5f-a106-25b190e343a6 for instance 2697de38-560e-4039-a65c-87c255d6b842 on hv-cinder-83754 Aug 31 09:55:01.422320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-5b45ac64-d173-43b8-ba10-23682adcfa69 req-47abb3c2-4319-44f5-96c1-1a544f07e885 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033808 Aug 31 09:55:01.422814 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 395/798] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:02.020121 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:02.020730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:02.028048 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:02.028528 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:02.028960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:02.029652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:02.030102 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:02.030525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:02.124205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:02.124910 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:02.131231 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:02.131791 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:02.132230 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:02.132926 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:02.133375 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:02.133795 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:02.180687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:02.188757 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b28ea80d-8672-4532-ad4c-401851f9d46e tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1314 microversion: 2.1 time: 0.172529 Aug 31 09:55:02.189362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 404/799] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:02 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:02.277206 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:02.285524 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:02.286971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:02.288937 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5e4e1b47-5b08-4c4b-8ed7-f32aeb5aadb3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.169569 Aug 31 09:55:02.289510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 396/800] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:02 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:02.349303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:02.350535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:02.356476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:02.356967 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:02.357402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:02.358100 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:02.358558 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:02.358976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:02.373307 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] HTTP exception thrown: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Request method failure captured: Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: DELETE /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac HTTP/1.1 Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy52w6wfH72f-sK25qErzAxt5rKNtYL1ccvYgQXOwyNK3IszxP6Ypgk7xGLyJfX63IJBEzMSARXZJ12Nqql2LpFy_MbWuF8-0XO3V5kJOAUUD9GGIIxHhKfCa62NMP_rKzUAmX_EZlGHRsbCJmcCF7lmt96i9_bByD0nlZ_h4y1vmsM Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:55:02.374929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: b6ca4276e1554d4184451313b2e09a88 Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.376832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': '84e870ae-a12e-4bd7-b49f-1bc976ea7bac'} Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:02.377596 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.378776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.380043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Returning 404 to user: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:02.380043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-71983622-a492-465f-9cac-6850e853b530 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 404 len: 111 microversion: 2.1 time: 0.030932 Aug 31 09:55:02.380043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 405/801] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:02 2022] DELETE /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:02.385116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:02.385733 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 84e870ae-a12e-4bd7-b49f-1bc976ea7bac] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:02.392478 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:02.392967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:02.393405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:02.394112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:02.394582 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:02.395007 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:02.411234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] HTTP exception thrown: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Request method failure captured: Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac HTTP/1.1 Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy52w6wfH72f-sK25qErzAxt5rKNtYL1ccvYgQXOwyNK3IszxP6Ypgk7xGLyJfX63IJBEzMSARXZJ12Nqql2LpFy_MbWuF8-0XO3V5kJOAUUD9GGIIxHhKfCa62NMP_rKzUAmX_EZlGHRsbCJmcCF7lmt96i9_bByD0nlZ_h4y1vmsM Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:02.413812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: b6ca4276e1554d4184451313b2e09a88 Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.415570 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '84e870ae-a12e-4bd7-b49f-1bc976ea7bac'} Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:02.416859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. Aug 31 09:55:02.418608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:02.420653 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Returning 404 to user: Instance 84e870ae-a12e-4bd7-b49f-1bc976ea7bac could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:02.420653 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8740a1fc-6cff-4645-9a53-15caf86b6e74 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac" status: 404 len: 111 microversion: 2.1 time: 0.034081 Aug 31 09:55:02.420653 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 397/802] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:02 2022] GET /compute/v2.1/servers/84e870ae-a12e-4bd7-b49f-1bc976ea7bac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:03.208826 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:03.209430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:03.216845 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:03.217324 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:03.217746 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:03.218432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:03.218878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:03.219332 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:03.312076 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:03.313538 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:03.321427 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:03.321994 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:03.322492 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:03.323294 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:03.323834 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:03.324330 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:03.354798 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:03.363500 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5876691e-e9a6-4413-88cb-6713d63ed855 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1314 microversion: 2.1 time: 0.158569 Aug 31 09:55:03.364172 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 406/803] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:03 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:03.492764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:03.501097 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:03.502509 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:03.503685 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4aea1b8a-587e-46f2-b229-16043afae08f tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1743 microversion: 2.20 time: 0.195597 Aug 31 09:55:03.504235 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 398/804] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:03 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:03.559382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:03.559920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:03.565801 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:03.566273 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:03.566701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:03.567420 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:03.567865 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:03.568283 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:03.581512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] HTTP exception thrown: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Request method failure captured: Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: DELETE /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 HTTP/1.1 Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy52w6wfH72f-sK25qErzAxt5rKNtYL1ccvYgQXOwyNK3IszxP6Ypgk7xGLyJfX63IJBEzMSARXZJ12Nqql2LpFy_MbWuF8-0XO3V5kJOAUUD9GGIIxHhKfCa62NMP_rKzUAmX_EZlGHRsbCJmcCF7lmt96i9_bByD0nlZ_h4y1vmsM Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:55:03.583031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: b6ca4276e1554d4184451313b2e09a88 Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.584600 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': '2795070d-ec5b-480c-91d5-f1317b74ea69'} Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:03.585474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.587800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.589310 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Returning 404 to user: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:03.589310 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5f504517-8e6d-457b-908f-c27e142cb063 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 404 len: 111 microversion: 2.1 time: 0.028972 Aug 31 09:55:03.589310 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 407/805] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:03 2022] DELETE /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:03.593070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:03.593682 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] [instance: 2795070d-ec5b-480c-91d5-f1317b74ea69] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:03.599749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:03.600224 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:03.600662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:03.602391 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:03.602391 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:03.602778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:03.618015 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] HTTP exception thrown: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Request method failure captured: Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 HTTP/1.1 Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy52w6wfH72f-sK25qErzAxt5rKNtYL1ccvYgQXOwyNK3IszxP6Ypgk7xGLyJfX63IJBEzMSARXZJ12Nqql2LpFy_MbWuF8-0XO3V5kJOAUUD9GGIIxHhKfCa62NMP_rKzUAmX_EZlGHRsbCJmcCF7lmt96i9_bByD0nlZ_h4y1vmsM Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:03.620028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/568beb0822e640c1bacd98a2aec950ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 568beb0822e640c1bacd98a2aec950ff Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeTestJSON-104271493 Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: b6ca4276e1554d4184451313b2e09a88 Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeTestJSON-104271493-project Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.621857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '2795070d-ec5b-480c-91d5-f1317b74ea69'} Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:03.622741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. Aug 31 09:55:03.624286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:03.625594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] Returning 404 to user: Instance 2795070d-ec5b-480c-91d5-f1317b74ea69 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:03.625594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-269a8098-0d5d-4913-a598-fb9d847ac491 tempest-AttachVolumeTestJSON-104271493 tempest-AttachVolumeTestJSON-104271493-project] 10.222.0.36 "GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69" status: 404 len: 111 microversion: 2.1 time: 0.032212 Aug 31 09:55:03.625594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 399/806] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:03 2022] GET /compute/v2.1/servers/2795070d-ec5b-480c-91d5-f1317b74ea69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:04.384716 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:04.385479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:04.392494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:04.393060 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:04.393565 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:04.394331 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:04.394847 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:04.395363 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:04.527396 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:04.528044 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:04.535251 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:04.535736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:04.536169 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:04.536935 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:04.537548 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:04.538106 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:04.568465 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:04.577782 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-710f206b-7980-41ee-a938-90c28702f452 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1314 microversion: 2.1 time: 0.196831 Aug 31 09:55:04.578375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 408/807] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:04 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:04.753656 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:04.759223 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=100 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:04.765010 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:04.766456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:04.767737 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c17a723c-c33c-48fd-9760-64ed3c0cf46b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1743 microversion: 2.20 time: 0.244572 Aug 31 09:55:04.768452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 400/808] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:04 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1743 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:05.598164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:05.598801 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:05.608056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:05.608555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:05.608986 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:05.609911 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:05.610366 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:05.610792 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:05.755709 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:05.765572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8e73bda5-6170-4122-885d-9a9eaee3ab10 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1314 microversion: 2.1 time: 0.171099 Aug 31 09:55:05.779927 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 409/809] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:05 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:05.790147 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:05.791449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:05.798664 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:05.799548 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:05.800440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:05.801444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:05.802066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:05.802868 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:06.080545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:06.094289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:06.095873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:06.097111 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-54c23ede-6dd9-4fd6-bac4-52f7ecb2c677 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.311194 Aug 31 09:55:06.098225 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 401/810] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:05 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:06.566133 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-016b4cd7-86a8-4ad3-8b02-83064b71070a req-f4af8c1e-f8b6-4df0-815c-de29ec629ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2697de38-560e-4039-a65c-87c255d6b842", "name": "network-vif-plugged", "status": "completed", "tag": "ef50d84a-a13e-4d5f-a106-25b190e343a6"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:06.586311 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-016b4cd7-86a8-4ad3-8b02-83064b71070a req-f4af8c1e-f8b6-4df0-815c-de29ec629ce3 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:06.586905 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-016b4cd7-86a8-4ad3-8b02-83064b71070a req-f4af8c1e-f8b6-4df0-815c-de29ec629ce3 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:06.593197 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-016b4cd7-86a8-4ad3-8b02-83064b71070a req-f4af8c1e-f8b6-4df0-815c-de29ec629ce3 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:06.622934 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-016b4cd7-86a8-4ad3-8b02-83064b71070a req-f4af8c1e-f8b6-4df0-815c-de29ec629ce3 service nova] Creating event network-vif-plugged:ef50d84a-a13e-4d5f-a106-25b190e343a6 for instance 2697de38-560e-4039-a65c-87c255d6b842 on hv-cinder-83754 Aug 31 09:55:06.630057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-016b4cd7-86a8-4ad3-8b02-83064b71070a req-f4af8c1e-f8b6-4df0-815c-de29ec629ce3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068035 Aug 31 09:55:06.639101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 410/811] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:06.797188 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:06.802582 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:06.821497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:06.823107 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:06.826133 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:06.832581 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:06.834729 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:06.835342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:07.123240 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:07.124036 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:07.148204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:07.154940 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:07.158568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:07.163340 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:07.165959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:07.168756 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:07.239332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:07.253027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-de7af2e8-0af6-480f-94ab-a7136ff3386d tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1314 microversion: 2.1 time: 0.465864 Aug 31 09:55:07.256086 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 402/812] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:06 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:07.443394 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:07.453636 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:07.455392 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:07.456728 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6a9e9a7d-7771-4b92-ae5f-b2a2d6f657ab tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.338672 Aug 31 09:55:07.457778 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 411/813] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:07 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:08.279035 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:08.279904 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:08.288132 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:08.289203 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:08.289850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:08.290573 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:08.291034 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:08.291558 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:08.364301 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:08.543046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:08.551329 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ad246369-91fb-4eda-b7e4-fe850f47b270 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1314 microversion: 2.1 time: 0.276364 Aug 31 09:55:08.551906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 403/814] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:08 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:08.670563 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-1e4fb3e4-f08d-4891-af21-9879dacbd8cf req-5e6ccd76-f822-493a-8d2f-97820adf2ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2a31fa-a87b-468d-8e3b-5065c7b93903", "name": "network-vif-plugged", "status": "completed", "tag": "c40dae88-cb20-491c-85ea-9cf688dd1840"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:08.689442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=8 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:08.691315 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-1e4fb3e4-f08d-4891-af21-9879dacbd8cf req-5e6ccd76-f822-493a-8d2f-97820adf2ffb service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:08.691791 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-1e4fb3e4-f08d-4891-af21-9879dacbd8cf req-5e6ccd76-f822-493a-8d2f-97820adf2ffb service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:08.692449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-1e4fb3e4-f08d-4891-af21-9879dacbd8cf req-5e6ccd76-f822-493a-8d2f-97820adf2ffb service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:08.717942 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-1e4fb3e4-f08d-4891-af21-9879dacbd8cf req-5e6ccd76-f822-493a-8d2f-97820adf2ffb service nova] Creating event network-vif-plugged:c40dae88-cb20-491c-85ea-9cf688dd1840 for instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 on hv-cinder-83754 Aug 31 09:55:08.724022 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-1e4fb3e4-f08d-4891-af21-9879dacbd8cf req-5e6ccd76-f822-493a-8d2f-97820adf2ffb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057021 Aug 31 09:55:08.724619 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 404/815] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:08.860696 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:08.861453 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:08.872973 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:08.874115 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:08.874845 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:08.879087 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:08.879895 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:08.880688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:09.072123 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:09.090896 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:09.093189 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:09.094629 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2e58262c-8d35-4e7d-887a-a197e9d8a888 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.614618 Aug 31 09:55:09.105670 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 412/816] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:08 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:09.579410 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:09.580873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:09.590391 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:09.591287 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:09.591990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:09.593171 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:09.593925 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:09.594566 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:09.778216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:09.786742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-efffd1a9-8fff-4104-b2aa-4e0e0ed55204 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1498 microversion: 2.1 time: 0.213032 Aug 31 09:55:09.795568 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 405/817] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:09 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1498 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:10.130271 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:10.130271 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:10.135046 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:10.135631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:10.137067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:10.137815 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:10.138285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:10.140896 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:10.350888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:10.360624 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:10.362212 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:10.363825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-de845ff9-ea68-47c7-a28f-60709f1483ff tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.243610 Aug 31 09:55:10.364644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 413/818] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:10 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:10.691911 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:10.692468 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:10.699105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:10.699828 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:10.700427 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:10.701154 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:10.701618 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:10.702049 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:10.730711 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Going to try to terminate instance {{(pid=132571) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:55:10.824519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9dd18abd-8431-4c6d-ab46-a765c8e66a20 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 204 len: 0 microversion: 2.1 time: 0.136262 Aug 31 09:55:10.828369 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 406/819] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:10 2022] DELETE /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:55:10.834189 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:10.835209 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:10.844899 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:10.845399 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:10.845840 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:10.847413 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:10.847413 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:10.847722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:11.018260 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:11.028054 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9a0c1eb1-7125-4d1f-a8cc-22da6b15cc99 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1504 microversion: 2.1 time: 0.198158 Aug 31 09:55:11.029275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 414/820] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:10 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:11.236943 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9c19697b-f3a0-420b-85df-7bedb7464ca1 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f9462974430>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:11.295864 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9c19697b-f3a0-420b-85df-7bedb7464ca1 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d347cc99-bd90-43a2-97db-75ec540b89f9" status: 200 len: 351 microversion: 2.1 time: 0.062318 Aug 31 09:55:11.297505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 407/821] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:55:11 2022] GET /compute/v2.1/os-volumes/d347cc99-bd90-43a2-97db-75ec540b89f9 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:11.388560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:11.389164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:11.395613 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:11.396319 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:11.397388 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:11.401454 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:11.402113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:11.402963 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:11.601174 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:11.611071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:11.612506 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:11.614005 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c9608a88-793d-4844-9d76-39688873ba51 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.229858 Aug 31 09:55:11.615071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 415/822] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:11 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:12.051154 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:12.051902 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:12.059738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:12.060222 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:12.060650 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:12.061354 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:12.061796 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:12.062215 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:12.223726 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:12.235245 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a1071334-ef44-47c6-b0e0-5b5c497065bd tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1504 microversion: 2.1 time: 0.188659 Aug 31 09:55:12.235833 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 408/823] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:12 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:12.637947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:12.638510 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:12.647041 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e909f332-768f-4fa5-a1f1-ca6e020b1648 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:12.647561 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e909f332-768f-4fa5-a1f1-ca6e020b1648 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:12.656215 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e909f332-768f-4fa5-a1f1-ca6e020b1648 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:12.656591 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e909f332-768f-4fa5-a1f1-ca6e020b1648 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:12.657037 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e909f332-768f-4fa5-a1f1-ca6e020b1648 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:12.657749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e909f332-768f-4fa5-a1f1-ca6e020b1648 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:12.658205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e909f332-768f-4fa5-a1f1-ca6e020b1648 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:12.658632 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e909f332-768f-4fa5-a1f1-ca6e020b1648 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:12.660515 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:12.661185 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:12.661616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:12.662320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:12.662775 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:12.663217 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:12.712885 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e909f332-768f-4fa5-a1f1-ca6e020b1648 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/ips" status: 200 len: 149 microversion: 2.1 time: 0.069717 Aug 31 09:55:12.722442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 409/824] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Aug 31 09:55:12 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/ips => generated 149 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:12.861990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b1c5cdd4-e823-4d2c-a266-f46fc99f8e12 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f94629704c0>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:12.928439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b1c5cdd4-e823-4d2c-a266-f46fc99f8e12 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/1396156f-00d1-4169-865b-9949b791300d" status: 200 len: 351 microversion: 2.1 time: 0.069844 Aug 31 09:55:12.938383 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 410/825] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:55:12 2022] GET /compute/v2.1/os-volumes/1396156f-00d1-4169-865b-9949b791300d => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:13.041158 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:13.052799 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:13.054850 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:13.056448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-71f49a93-ddb9-4521-addf-f0f52cd6922c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.422474 Aug 31 09:55:13.057640 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 416/826] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:12 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:13.267655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:13.268266 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:13.296429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:13.297270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:13.297880 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:13.298736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:13.300988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:13.301547 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:13.406724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-65f64d96-8bd0-4b2d-88d2-2d6e7988ef9a req-fd6d7c26-f4ca-441b-b34e-8f1f25c1524e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2697de38-560e-4039-a65c-87c255d6b842", "name": "network-vif-deleted", "tag": "ef50d84a-a13e-4d5f-a106-25b190e343a6"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:13.425188 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1530c2946ff3486daf7c8b2b70c1a3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7713ff3ccc8546b68a89f2e2087d5abf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:13.431430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-65f64d96-8bd0-4b2d-88d2-2d6e7988ef9a req-fd6d7c26-f4ca-441b-b34e-8f1f25c1524e service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:13.431952 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-65f64d96-8bd0-4b2d-88d2-2d6e7988ef9a req-fd6d7c26-f4ca-441b-b34e-8f1f25c1524e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:13.432347 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-65f64d96-8bd0-4b2d-88d2-2d6e7988ef9a req-fd6d7c26-f4ca-441b-b34e-8f1f25c1524e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:13.438527 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b769a12e-c226-4ce3-b6f6-d316e886c90b tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 200 len: 1462 microversion: 2.1 time: 0.184192 Aug 31 09:55:13.443160 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 411/827] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:13 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 1462 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:13.459607 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-65f64d96-8bd0-4b2d-88d2-2d6e7988ef9a req-fd6d7c26-f4ca-441b-b34e-8f1f25c1524e service nova] Creating event network-vif-deleted:ef50d84a-a13e-4d5f-a106-25b190e343a6 for instance 2697de38-560e-4039-a65c-87c255d6b842 on hv-cinder-83754 Aug 31 09:55:13.466150 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-65f64d96-8bd0-4b2d-88d2-2d6e7988ef9a req-fd6d7c26-f4ca-441b-b34e-8f1f25c1524e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064928 Aug 31 09:55:13.469691 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 417/828] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:14.081971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:14.082600 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:14.089026 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:14.090891 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:14.091413 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:14.091874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:14.092568 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:14.097560 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:14.098203 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:14.273704 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:14.287145 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:14.289930 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:14.292101 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7d0e1748-ca6f-469e-8819-182eb72f360d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.213988 Aug 31 09:55:14.308484 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 412/829] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:14 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:14.425614 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-49094f92-33ae-40f3-8640-0980a9138760 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d030bed-cf11-4c8d-aa82-7a179fc083bc"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:14.428223 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-49094f92-33ae-40f3-8640-0980a9138760 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:14.438395 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:14.441001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49094f92-33ae-40f3-8640-0980a9138760 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:14.441701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49094f92-33ae-40f3-8640-0980a9138760 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:14.442199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49094f92-33ae-40f3-8640-0980a9138760 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:14.443320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49094f92-33ae-40f3-8640-0980a9138760 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:14.443854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49094f92-33ae-40f3-8640-0980a9138760 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:14.444342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-49094f92-33ae-40f3-8640-0980a9138760 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:14.465184 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:14.467111 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] [instance: 2697de38-560e-4039-a65c-87c255d6b842] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:14.491545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:14.491545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:14.491545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:14.491545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:14.492045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:14.492045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:14.508974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] HTTP exception thrown: Instance 2697de38-560e-4039-a65c-87c255d6b842 could not be found. Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Request method failure captured: Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 HTTP/1.1 Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy_eLXQdvrCd_mJecx5ba0bzFOL7zOR9pmnwN_76DioQvLB5JmjOePb5cWQqRtSA1dopg1AW-W4t7PoppmJfHrXodWPRYDJWT1zur08MDHZwsTYu4e-KQaisdGmkR9k65bBX_Xn-y9V7hKdjePWelQ8cwmx8l4q8mQzcZKI1_Bnou-o Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 7713ff3ccc8546b68a89f2e2087d5abf Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-VolumesActionsTest-918794272 Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:14.514116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7713ff3ccc8546b68a89f2e2087d5abf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/7713ff3ccc8546b68a89f2e2087d5abf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_7713ff3ccc8546b68a89f2e2087d5abf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/7713ff3ccc8546b68a89f2e2087d5abf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-VolumesActionsTest-918794272 Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 7713ff3ccc8546b68a89f2e2087d5abf Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-VolumesActionsTest-918794272 Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-VolumesActionsTest-918794272-project Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 1530c2946ff3486daf7c8b2b70c1a3b6 Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-VolumesActionsTest-918794272-project Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 2697de38-560e-4039-a65c-87c255d6b842 could not be found. Aug 31 09:55:14.515611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '2697de38-560e-4039-a65c-87c255d6b842'} Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2697de38-560e-4039-a65c-87c255d6b842 could not be found. Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:14.516345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2697de38-560e-4039-a65c-87c255d6b842 could not be found. Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2697de38-560e-4039-a65c-87c255d6b842 could not be found. Aug 31 09:55:14.517510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:14.518583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] Returning 404 to user: Instance 2697de38-560e-4039-a65c-87c255d6b842 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:14.518583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-91314a84-e76d-4f86-83db-05dcf1a3d363 tempest-VolumesActionsTest-918794272 tempest-VolumesActionsTest-918794272-project] 10.222.0.36 "GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842" status: 404 len: 111 microversion: 2.1 time: 0.055846 Aug 31 09:55:14.518583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 413/830] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:14 2022] GET /compute/v2.1/servers/2697de38-560e-4039-a65c-87c255d6b842 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:14.527630 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1c6e18dc-9cdf-496c-a683-11dcd117de59 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f9462970700>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:14.638752 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1c6e18dc-9cdf-496c-a683-11dcd117de59 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c46f3b46-ec5e-4984-ae16-82cdbaa72371" status: 200 len: 351 microversion: 2.1 time: 0.121602 Aug 31 09:55:14.639599 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 414/831] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Aug 31 09:55:14 2022] GET /compute/v2.1/os-volumes/c46f3b46-ec5e-4984-ae16-82cdbaa72371 => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:14.662399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2d50f614-a7bd-4ad7-ab57-42ede20ef881 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f94629705e0>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:14.782115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2d50f614-a7bd-4ad7-ab57-42ede20ef881 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.130082 Aug 31 09:55:14.791353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 415/832] 10.222.0.36 () {58 vars in 1134 bytes} [Wed Aug 31 09:55:14 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:14.797912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7ab52e68-dd78-416a-b033-c119951cd632 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f94629460d0>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:14.921717 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:14.934746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7ab52e68-dd78-416a-b033-c119951cd632 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.140704 Aug 31 09:55:14.938485 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-49094f92-33ae-40f3-8640-0980a9138760 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "POST /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.517687 Aug 31 09:55:14.939088 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 418/833] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:55:14 2022] POST /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-volume_attachments => generated 194 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:14.957128 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5f2b9c35-faef-4eb8-9f51-1190d895352f tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f94695ddb80>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:14.961586 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 416/834] 10.222.0.36 () {58 vars in 1149 bytes} [Wed Aug 31 09:55:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:15.146086 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5f2b9c35-faef-4eb8-9f51-1190d895352f tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.193261 Aug 31 09:55:15.146668 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 419/835] 10.222.0.36 () {58 vars in 1134 bytes} [Wed Aug 31 09:55:14 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:15.160685 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8eecfa8a-4951-4620-9001-547afc2e2597 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f94629703a0>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:15.264841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8eecfa8a-4951-4620-9001-547afc2e2597 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.108557 Aug 31 09:55:15.265525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 417/836] 10.222.0.36 () {58 vars in 1167 bytes} [Wed Aug 31 09:55:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:15.279873 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-837ae82f-1ef6-441e-a605-b831f44d41a4 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f9462a2adc0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:15.319282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:15.321362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:15.334043 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:15.334771 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:15.335969 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:15.336973 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:15.337606 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:15.338037 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:15.419756 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-837ae82f-1ef6-441e-a605-b831f44d41a4 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.144047 Aug 31 09:55:15.420340 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 420/837] 10.222.0.36 () {58 vars in 1170 bytes} [Wed Aug 31 09:55:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:15.441599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-19a28fec-a5af-42dd-a5a7-50b373968702 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f94629ea940>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:15.523713 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:15.533204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:15.534657 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:15.535873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0aad7be1-0ecf-4901-a9ab-bdd128fc4158 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.220433 Aug 31 09:55:15.552043 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 418/838] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:15 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:15.585199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-19a28fec-a5af-42dd-a5a7-50b373968702 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.152884 Aug 31 09:55:15.586485 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 421/839] 10.222.0.36 () {58 vars in 1155 bytes} [Wed Aug 31 09:55:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:15.606624 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4d386592-0b72-41f6-b72c-494a10a6f56e tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f9462970940>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:15.730116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4d386592-0b72-41f6-b72c-494a10a6f56e tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.132929 Aug 31 09:55:15.730905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 419/840] 10.222.0.36 () {58 vars in 1188 bytes} [Wed Aug 31 09:55:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:15.749470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-59343ef7-dacd-4235-8b75-60ff982c89b1 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] Calling method '.version_select at 0x7f9462aa1dc0>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:15.872995 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-59343ef7-dacd-4235-8b75-60ff982c89b1 tempest-VolumesTestJSON-1428978713 tempest-VolumesTestJSON-1428978713-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.127486 Aug 31 09:55:15.890762 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 422/841] 10.222.0.36 () {58 vars in 1155 bytes} [Wed Aug 31 09:55:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:16.565262 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:16.565873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:16.574356 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:16.574856 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:16.575507 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:16.576404 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:16.576861 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:16.577474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:16.739716 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:16.752578 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:16.753256 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:16.754500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9cbe9b4d-9209-47e3-88ac-6072175610f0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.196482 Aug 31 09:55:16.755057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 420/842] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:16 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:17.782698 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:17.783466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:17.790320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:17.790800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:17.791268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:17.791952 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:17.792405 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:17.792825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:17.927267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:17.936124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:17.937622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:17.938792 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e7d7cd7a-6dfb-4213-96e1-5c822b47ad1c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.160489 Aug 31 09:55:17.939385 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 423/843] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:17 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:18.962799 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:18.963427 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:18.970094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:18.970582 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:18.971024 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:18.971754 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:18.972210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:18.972634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:19.114317 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:19.123589 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:19.125038 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:19.126205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-703094c6-da6d-4cee-a449-3c57a957cfdb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1738 microversion: 2.20 time: 0.167602 Aug 31 09:55:19.126858 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 421/844] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:18 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:20.150450 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:20.151078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:20.157805 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:20.158415 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:20.158848 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:20.159568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:20.160019 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:20.160443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:20.303220 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:20.312397 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:20.314761 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:20.316051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-10f82494-57bd-4cae-9d85-1bc44b2c23a9 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1720 microversion: 2.20 time: 0.170360 Aug 31 09:55:20.316521 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 424/845] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:20 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:21.339913 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:21.340457 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:21.348313 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:21.349127 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:21.349773 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:21.351287 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:21.352400 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:21.352862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:21.547865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:21.560862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:21.564430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:21.566274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ba7da72b-7384-46f1-ac05-4c13fb506cf8 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1720 microversion: 2.20 time: 0.230628 Aug 31 09:55:21.579849 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 422/846] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:21 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1720 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:22.391692 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-cc857ae3-ed63-4fa2-8e7b-3ad5523904e4 req-6bc01c21-67ea-4703-8d4f-64ab59477ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2a31fa-a87b-468d-8e3b-5065c7b93903", "name": "network-vif-unplugged", "status": "completed", "tag": "c40dae88-cb20-491c-85ea-9cf688dd1840"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:22.405814 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-cc857ae3-ed63-4fa2-8e7b-3ad5523904e4 req-6bc01c21-67ea-4703-8d4f-64ab59477ac7 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:22.406484 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-cc857ae3-ed63-4fa2-8e7b-3ad5523904e4 req-6bc01c21-67ea-4703-8d4f-64ab59477ac7 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:22.406904 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-cc857ae3-ed63-4fa2-8e7b-3ad5523904e4 req-6bc01c21-67ea-4703-8d4f-64ab59477ac7 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:22.424349 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-cc857ae3-ed63-4fa2-8e7b-3ad5523904e4 req-6bc01c21-67ea-4703-8d4f-64ab59477ac7 service nova] Creating event network-vif-unplugged:c40dae88-cb20-491c-85ea-9cf688dd1840 for instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 on hv-cinder-83754 Aug 31 09:55:22.439020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-cc857ae3-ed63-4fa2-8e7b-3ad5523904e4 req-6bc01c21-67ea-4703-8d4f-64ab59477ac7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052041 Aug 31 09:55:22.440143 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 425/847] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:22.613774 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:22.614825 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:22.624034 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:22.624528 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:22.625050 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:22.625832 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:22.626289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:22.626751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:22.874044 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:22.887651 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:22.892089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:22.893751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a6bcff31-fd22-4b70-8820-9dc170523410 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1723 microversion: 2.20 time: 0.296812 Aug 31 09:55:22.894429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 423/848] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:22 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:22.935347 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fac7c31f-5a74-4ba7-a63b-ec824f50dbc4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b46bbe63-527d-45f7-afa4-7cad78e78246"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:22.939798 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fac7c31f-5a74-4ba7-a63b-ec824f50dbc4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:22.948787 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fac7c31f-5a74-4ba7-a63b-ec824f50dbc4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:22.949727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fac7c31f-5a74-4ba7-a63b-ec824f50dbc4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:22.950369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fac7c31f-5a74-4ba7-a63b-ec824f50dbc4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:22.951357 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fac7c31f-5a74-4ba7-a63b-ec824f50dbc4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:22.952029 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fac7c31f-5a74-4ba7-a63b-ec824f50dbc4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:22.952654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fac7c31f-5a74-4ba7-a63b-ec824f50dbc4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:23.478753 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fac7c31f-5a74-4ba7-a63b-ec824f50dbc4 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.562458 Aug 31 09:55:23.479482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 426/849] 10.222.0.36 () {62 vars in 1364 bytes} [Wed Aug 31 09:55:22 2022] POST /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/os-volume_attachments => generated 188 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 09:55:23.719344 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-982a6bba-a905-48ca-8aca-ccb1824ccbdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:23.720237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-982a6bba-a905-48ca-8aca-ccb1824ccbdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:23.730463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-982a6bba-a905-48ca-8aca-ccb1824ccbdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:23.731277 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-982a6bba-a905-48ca-8aca-ccb1824ccbdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:23.731874 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-982a6bba-a905-48ca-8aca-ccb1824ccbdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:23.732764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-982a6bba-a905-48ca-8aca-ccb1824ccbdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:23.733394 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-982a6bba-a905-48ca-8aca-ccb1824ccbdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:23.734005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-982a6bba-a905-48ca-8aca-ccb1824ccbdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:23.759906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:24.028842 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:24.029342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:24.039049 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.039568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.040017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.040736 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.041193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.041618 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.169561 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-982a6bba-a905-48ca-8aca-ccb1824ccbdf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/os-volume_attachments/b46bbe63-527d-45f7-afa4-7cad78e78246" status: 202 len: 0 microversion: 2.20 time: 0.456950 Aug 31 09:55:24.179367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 424/850] 10.222.0.36 () {60 vars in 1457 bytes} [Wed Aug 31 09:55:23 2022] DELETE /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/os-volume_attachments/b46bbe63-527d-45f7-afa4-7cad78e78246 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:55:24.189216 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lazy-loading 'services' on Instance uuid b16f723b-daa7-4873-9171-c4cc20ba31f4 {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:55:24.297828 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:24.299002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:24.309182 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.310195 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.310810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.311595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.312236 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.313153 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.329067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4e2cb7de-ba94-467f-ba6c-6f33b2dc88dd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-volume_attachments/8d030bed-cf11-4c8d-aa82-7a179fc083bc" status: 202 len: 0 microversion: 2.1 time: 0.301924 Aug 31 09:55:24.331828 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 427/851] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:55:24 2022] DELETE /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-volume_attachments/8d030bed-cf11-4c8d-aa82-7a179fc083bc => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 09:55:24.347276 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1ce04d62-4094-47bb-b4ce-a66727b739b5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:24.356044 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132571) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 09:55:24.356301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1ce04d62-4094-47bb-b4ce-a66727b739b5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:24.374425 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ce04d62-4094-47bb-b4ce-a66727b739b5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.375672 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ce04d62-4094-47bb-b4ce-a66727b739b5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.376549 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ce04d62-4094-47bb-b4ce-a66727b739b5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.377810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ce04d62-4094-47bb-b4ce-a66727b739b5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.378898 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ce04d62-4094-47bb-b4ce-a66727b739b5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.379988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ce04d62-4094-47bb-b4ce-a66727b739b5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.505031 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1ce04d62-4094-47bb-b4ce-a66727b739b5 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166498 Aug 31 09:55:24.508308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 428/852] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:24 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:24.523649 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-75f43751-a845-49b8-a984-774a58ba9a6c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "POST /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/action" status: 202 len: 0 microversion: 2.20 time: 0.231165 Aug 31 09:55:24.525119 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 425/853] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Aug 31 09:55:24 2022] POST /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:55:24.558246 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:24.559083 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:24.575192 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.575689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.576125 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.576846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:24.577299 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:24.577730 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:24.901221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:24.919281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:24.921482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:24.938190 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2ae61926-3b0a-439a-b465-05c7ee97d66d tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1671 microversion: 2.20 time: 0.406979 Aug 31 09:55:24.939113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 429/854] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:24 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1671 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:25.524630 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1f1d6b08-04f5-4e93-933f-074eaf740a13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:25.530963 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1f1d6b08-04f5-4e93-933f-074eaf740a13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:25.546724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f1d6b08-04f5-4e93-933f-074eaf740a13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.547260 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f1d6b08-04f5-4e93-933f-074eaf740a13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.549104 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f1d6b08-04f5-4e93-933f-074eaf740a13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.550043 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f1d6b08-04f5-4e93-933f-074eaf740a13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.552610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f1d6b08-04f5-4e93-933f-074eaf740a13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.553063 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f1d6b08-04f5-4e93-933f-074eaf740a13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.627746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1f1d6b08-04f5-4e93-933f-074eaf740a13 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111343 Aug 31 09:55:25.635108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 426/855] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 09:55:25 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 09:55:25.751256 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:25.751882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:25.801522 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.806142 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.806638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.807710 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.808178 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.808605 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.894945 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:55:25.974346 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:25.975904 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:25.988740 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.989418 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.990188 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:25.992741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:25.994369 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:25.995176 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:26.033969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3fe7238b-9e3c-4c93-9f8a-0340971c12fd tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 204 len: 0 microversion: 2.1 time: 0.286217 Aug 31 09:55:26.035450 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 430/856] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:25 2022] DELETE /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:55:26.051677 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:26.052750 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:26.064169 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:26.065072 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:26.066067 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:26.067229 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:26.067892 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:26.068497 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:26.171217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:26.184975 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:26.186448 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:26.187941 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e88d5422-a585-40ed-b3bd-3b1c434c201a tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.219347 Aug 31 09:55:26.188851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 427/857] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:25 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:26.292982 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:26.301964 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-65d4dbee-b0c7-4e50-918a-450f60108412 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1680 microversion: 2.1 time: 0.260544 Aug 31 09:55:26.303460 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 431/858] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:26 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:27.212631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:27.213398 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:27.220997 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.221585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.222019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:27.222731 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.223216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.223858 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:27.334054 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:27.335474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:27.349718 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.352128 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.352722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:27.354124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:27.355027 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:27.355480 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:27.489527 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:27.501165 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:27.502783 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:27.504007 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-22a657c7-c175-4710-895b-40ea90709ef6 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.295637 Aug 31 09:55:27.504989 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 428/859] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:27 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:27.538517 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:27.556098 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6b684149-b9a4-4ba4-8b89-9fefcc4e832b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1680 microversion: 2.1 time: 0.228760 Aug 31 09:55:27.569687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 432/860] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:27 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:28.527858 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:28.529577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:28.547371 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.552178 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.558721 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.560393 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.561357 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.562021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.577376 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:28.578020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:28.602436 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.604503 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.606009 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.608875 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:28.610051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:28.611579 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:28.940234 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:28.949548 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-921061c2-f0b9-4027-b18c-87bb141a0041 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1680 microversion: 2.1 time: 0.375885 Aug 31 09:55:28.950137 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 433/861] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:28 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1680 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:28.964471 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:28.973085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:28.974709 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:28.977159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ac2cb934-f131-4d91-b24c-84ae42a6c5f2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.452922 Aug 31 09:55:28.978481 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 429/862] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:28 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:29.976696 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:29.977599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:29.995504 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:29.996515 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.001818 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:30.003172 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:30.007319 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.008456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.009113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.009720 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.024715 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.026826 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.028265 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.030032 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.031271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.033582 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.120425 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:30.132983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1ccfd9fe-7b4a-4473-927a-40268c85993b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1613 microversion: 2.1 time: 0.160954 Aug 31 09:55:30.147032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 434/863] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:29 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1613 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:30.344851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:30.367232 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:30.369488 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:30.371342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ea53b997-574a-4d5d-8a52-4c4465c0f665 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.373060 Aug 31 09:55:30.372686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 430/864] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:29 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:55:30.705215 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-65ff440c-4f6f-4d83-98c1-9ca55173e90a req-ad8e45a9-cf5a-4acf-b4b2-41173aee665b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16f723b-daa7-4873-9171-c4cc20ba31f4", "name": "network-vif-deleted", "tag": "9f90497f-7f0b-4b71-af6c-899933f8c225"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:30.751727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-65ff440c-4f6f-4d83-98c1-9ca55173e90a req-ad8e45a9-cf5a-4acf-b4b2-41173aee665b service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:30.752309 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-65ff440c-4f6f-4d83-98c1-9ca55173e90a req-ad8e45a9-cf5a-4acf-b4b2-41173aee665b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:30.752804 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-65ff440c-4f6f-4d83-98c1-9ca55173e90a req-ad8e45a9-cf5a-4acf-b4b2-41173aee665b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:30.764027 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:30.784775 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-65ff440c-4f6f-4d83-98c1-9ca55173e90a req-ad8e45a9-cf5a-4acf-b4b2-41173aee665b service nova] Creating event network-vif-deleted:9f90497f-7f0b-4b71-af6c-899933f8c225 for instance b16f723b-daa7-4873-9171-c4cc20ba31f4 on hv-cinder-83754 Aug 31 09:55:30.793367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-65ff440c-4f6f-4d83-98c1-9ca55173e90a req-ad8e45a9-cf5a-4acf-b4b2-41173aee665b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100713 Aug 31 09:55:30.794774 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 435/865] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:31.156337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:31.157587 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:31.169846 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.170161 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.170746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.172728 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.173116 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.174995 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.264705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:31.276778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-30606917-a27c-47b4-9e3f-c4c7414f6e1d tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1613 microversion: 2.1 time: 0.124331 Aug 31 09:55:31.290881 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 431/866] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:31 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1613 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:31.399227 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:31.399926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:31.412910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.413418 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.414190 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.415043 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:31.415625 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:31.416840 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:31.655502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:31.669224 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:31.670858 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:31.672079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f58213e7-c96d-440a-8420-2147c291adf2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.279468 Aug 31 09:55:31.672660 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 436/867] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:31 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:32.298363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:32.299266 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:32.306727 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:32.307743 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:32.308339 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:32.309346 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:32.309947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:32.310519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:32.383455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:32.394797 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-958149bf-1cb1-4f85-9f6e-0bff756fe1db tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1613 microversion: 2.1 time: 0.100641 Aug 31 09:55:32.395585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 432/868] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:32 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:32.698087 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:32.699440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:32.707494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:32.708356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:32.708889 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:32.709714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:32.710424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:32.711374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:32.987585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:33.000817 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:33.002957 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:33.004815 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-d736cacd-1392-4fd3-9f30-c198edb400cf tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.312477 Aug 31 09:55:33.005597 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 437/869] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:32 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:33.420111 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:33.422595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:33.435446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:33.436034 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:33.436711 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:33.437729 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:33.438419 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:33.439101 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:33.481251 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:33.482203 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:33.482711 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:33.483353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lazy-loading 'fault' on Instance uuid b16f723b-daa7-4873-9171-c4cc20ba31f4 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:55:33.541741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '980ab18eb5c646378d738079621a0dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4914faafb494e5bb323114853f25c54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:33.563315 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-253b901d-79de-436d-8c18-0b02df78d66a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 200 len: 1331 microversion: 2.1 time: 0.149512 Aug 31 09:55:33.572296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 433/870] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:33 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 1331 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:34.057416 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:34.058102 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:34.071219 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:34.071726 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:34.072157 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:34.072911 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:34.073362 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:34.073946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:34.372869 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:34.406353 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:34.407904 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:34.409477 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-68fb90f8-39a0-4d83-8c54-a327d6a74a8b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.357973 Aug 31 09:55:34.410059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 438/871] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:34 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:34.601324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:34.604574 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:34.631111 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:34.635988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:34.637090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:34.648068 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:34.649155 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:34.650431 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:34.691085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 HTTP/1.1 Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:34.695596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:34.697051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'b16f723b-daa7-4873-9171-c4cc20ba31f4'} Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:34.697810 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:34.699080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:34.700356 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:34.700356 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-df00d947-3086-4252-b979-f0c6ab4e6893 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 404 len: 111 microversion: 2.1 time: 0.113419 Aug 31 09:55:34.700356 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 434/872] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:34 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:34.710405 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3a668d5b-6552-4f6b-a4dc-02c61e620cf4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '.version_select at 0x7f9462932a60>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:34.741530 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3a668d5b-6552-4f6b-a4dc-02c61e620cf4 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-812361715" status: 202 len: 0 microversion: 2.1 time: 0.033936 Aug 31 09:55:34.743553 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 439/873] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Aug 31 09:55:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-812361715 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:55:35.440533 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:35.442335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:35.458385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:35.461482 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:35.462438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:35.465046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:35.467729 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:35.468387 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:35.885269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:35.904112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:35.906248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:35.908561 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ac5244c1-9ad3-4cb0-90a0-cb60fb5e8d14 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.474876 Aug 31 09:55:35.909362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 435/874] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:35 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:36.937261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:36.937964 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:36.957576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:36.958200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:36.958651 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:36.959930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:36.960511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:36.961109 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.221960 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:37.223192 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:37.239454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.240337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.241188 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.242613 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.243474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.244143 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.266368 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: DELETE /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 HTTP/1.1 Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:37.268945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.270399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'b16f723b-daa7-4873-9171-c4cc20ba31f4'} Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:37.271298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.273449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.275947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:37.277198 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fc312d8d-7e54-404c-86f5-220f6b6d24c2 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 404 len: 111 microversion: 2.1 time: 0.060124 Aug 31 09:55:37.280931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 436/875] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:37 2022] DELETE /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:55:37.288379 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:37.289297 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: b16f723b-daa7-4873-9171-c4cc20ba31f4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:37.305171 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:37.322520 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:37.324083 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:37.326488 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.327718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.328787 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.331145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-54793e5c-880f-4f11-923d-29458e39c47e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.397709 Aug 31 09:55:37.332724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:37.333464 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:37.335830 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:37.340456 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 440/876] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:36 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:37.372411 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 HTTP/1.1 Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:37.374720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.376454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'b16f723b-daa7-4873-9171-c4cc20ba31f4'} Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:37.377332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. Aug 31 09:55:37.379001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:37.383072 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance b16f723b-daa7-4873-9171-c4cc20ba31f4 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:37.384458 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1efca03c-840d-4a9b-af51-7112735d6e59 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4" status: 404 len: 111 microversion: 2.1 time: 0.101490 Aug 31 09:55:37.385592 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 437/877] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:37 2022] GET /compute/v2.1/servers/b16f723b-daa7-4873-9171-c4cc20ba31f4 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:38.357660 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.359070 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.368921 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.371997 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.372642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.376262 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.376958 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.377570 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.671585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.672885 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.682205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.686462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.687281 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.690597 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.691295 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.691967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.728725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: DELETE /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 HTTP/1.1 Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:38.731873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.733551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '37b2cb47-9a46-450e-8bd9-f125d5aba697'} Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:38.734326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.735646 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.743017 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:38.744352 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-23ccb7d1-0f5c-45c1-a5be-c90239fd6402 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 404 len: 111 microversion: 2.1 time: 0.077481 Aug 31 09:55:38.745465 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 438/878] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:38 2022] DELETE /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:38.760279 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.761375 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 37b2cb47-9a46-450e-8bd9-f125d5aba697] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.777909 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.781865 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.782683 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.783699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.785905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.786712 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.827769 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 HTTP/1.1 Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:38.829662 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.831094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '37b2cb47-9a46-450e-8bd9-f125d5aba697'} Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:38.832204 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. Aug 31 09:55:38.833456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.835201 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance 37b2cb47-9a46-450e-8bd9-f125d5aba697 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:38.835201 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ce01bf67-fb54-4b1f-85d7-4b131c71ed1b tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697" status: 404 len: 111 microversion: 2.1 time: 0.078691 Aug 31 09:55:38.835201 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 439/879] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:38 2022] GET /compute/v2.1/servers/37b2cb47-9a46-450e-8bd9-f125d5aba697 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:38.850202 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.851306 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.859595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.860134 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.860581 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.861296 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.861754 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.863172 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.904028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: DELETE /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a HTTP/1.1 Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:38.906335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.907741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '02f44622-25b4-4470-85c3-bb4c09cbea6a'} Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:38.908474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.909741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.910927 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:38.910927 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ae197ac6-ac2f-4a62-9d81-470016c65f49 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 404 len: 111 microversion: 2.1 time: 0.069654 Aug 31 09:55:38.910927 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 440/880] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:38 2022] DELETE /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:55:38.926663 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:38.927555 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: 02f44622-25b4-4470-85c3-bb4c09cbea6a] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:38.943060 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:38.949702 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.950314 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.951207 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.953145 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:38.953620 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:38.954058 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:38.963646 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:38.965135 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:38.966353 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b9d9a435-ec40-4f03-b1d4-69489ebcb896 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.612801 Aug 31 09:55:38.966932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 441/881] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:38 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:38.971604 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a HTTP/1.1 Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:38.973821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.975242 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '02f44622-25b4-4470-85c3-bb4c09cbea6a'} Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:38.976433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. Aug 31 09:55:38.977642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:38.978693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance 02f44622-25b4-4470-85c3-bb4c09cbea6a could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:38.978693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-758be955-3fda-4813-bc82-d6d85466caf3 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a" status: 404 len: 111 microversion: 2.1 time: 0.062394 Aug 31 09:55:38.978693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 441/882] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:38 2022] GET /compute/v2.1/servers/02f44622-25b4-4470-85c3-bb4c09cbea6a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:39.996162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:39.996789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:40.018462 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.019058 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.023060 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.024612 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.025182 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.025665 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.273212 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:40.301619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:40.303975 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:40.305764 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-bee20a35-b183-4c0b-bace-d28ae91a14eb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.315599 Aug 31 09:55:40.306911 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 442/883] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:39 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:40.468979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:40.469668 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:40.487772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.489115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.489969 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.491758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.492508 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.493202 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.514440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:40.514440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: DELETE /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 HTTP/1.1 Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:55:40.516286 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.518282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'c84e69de-d263-47c5-a190-3e39a8087f17'} Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:40.519451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.521305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.524187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:40.531021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-239ca2b4-d2f2-41df-83c0-3a4f16a1cd4a tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 404 len: 111 microversion: 2.1 time: 0.061418 Aug 31 09:55:40.531021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 442/884] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:55:40 2022] DELETE /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:40.535636 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:40.536226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] [instance: c84e69de-d263-47c5-a190-3e39a8087f17] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:40.545697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.546204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.546658 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.552106 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:40.552644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:40.553732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:40.602647 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] HTTP exception thrown: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Request method failure captured: Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 HTTP/1.1 Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy53_lAH2yvE-JIfxYPW3rlRNUoIR-OuugOjTuoYJJG1AiBcs0-OlBOp4zyfAH7Y7JuJ0Rtq_K8cMWW7FgCoD2RZsoX-4Rw3TR98iqtb13gDA_uWITSL4MxMccJZXZODYXhcgYQCpkj12IEmQeMwmr5f3lbbnTUfTFCJqdkjkWN_CEE Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:55:40.616793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/c4914faafb494e5bb323114853f25c54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_c4914faafb494e5bb323114853f25c54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/c4914faafb494e5bb323114853f25c54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: c4914faafb494e5bb323114853f25c54 Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-706228933 Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 980ab18eb5c646378d738079621a0dbc Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeNegativeTest-706228933-project Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.618962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'c84e69de-d263-47c5-a190-3e39a8087f17'} Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:55:40.620289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. Aug 31 09:55:40.622126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:55:40.627715 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] Returning 404 to user: Instance c84e69de-d263-47c5-a190-3e39a8087f17 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:55:40.627715 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e48b1920-352f-4da1-83c2-bcadf00c0f60 tempest-AttachVolumeNegativeTest-706228933 tempest-AttachVolumeNegativeTest-706228933-project] 10.222.0.36 "GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17" status: 404 len: 111 microversion: 2.1 time: 0.090456 Aug 31 09:55:40.627715 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 443/885] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:40 2022] GET /compute/v2.1/servers/c84e69de-d263-47c5-a190-3e39a8087f17 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:41.334805 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:41.336214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:41.356096 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:41.359018 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:41.359785 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:41.361476 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:41.362397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:41.364757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:41.701519 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:41.736388 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:41.746153 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:41.751082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8e5000cc-72ae-44b8-86a8-77d5cb216bbb tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.422240 Aug 31 09:55:41.753744 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 443/886] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:41 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:42.779426 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:42.781874 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:42.798786 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.802100 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.802742 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:42.806101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:42.806689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:42.808930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:43.142660 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:43.155853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:43.160400 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:43.165576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8ffe9d5f-995b-4bf1-9b8b-a32cbc8d6d72 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.391388 Aug 31 09:55:43.171012 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 444/887] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:42 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:44.200511 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:44.203554 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:44.215100 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:44.219319 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.220571 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.222295 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:44.223802 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:44.228748 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:44.229415 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:44.573585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:44.593381 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:44.598436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:44.601057 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d81016d6-b61f-46e6-a699-ff3f37d2d059 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.410969 Aug 31 09:55:44.608119 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 444/888] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:44 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:45.633823 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:45.634432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:45.637252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:45.643153 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:45.643634 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:45.644064 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:45.644846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:45.645303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:45.649270 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:46.012809 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:46.032475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:46.034148 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:46.036184 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-cbc3be49-8ce2-4619-920a-9ab53f6737d3 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.406466 Aug 31 09:55:46.051212 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 445/889] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:45 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:47.061999 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:47.065392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:47.074149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:47.074870 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:47.075407 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:47.076198 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:47.076666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:47.077089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:47.442933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:47.455231 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:47.456941 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:47.464663 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8411d43b-875a-4efe-a009-6d0fd1549c5c tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.406001 Aug 31 09:55:47.465438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 445/890] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:47 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:48.487611 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:48.488211 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:48.496386 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:48.497201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:48.497594 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.498424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:48.498993 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:48.499859 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.703589 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:48.727871 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:48.732414 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:48.735917 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-53eb7dd7-e384-4a87-a794-45cbf5e524de tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.251147 Aug 31 09:55:48.738462 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 446/891] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:48 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:48.921027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-d5a9bb63-ab6c-4bda-8a6a-30de0ed280f3 req-1a2127c8-840c-42e5-a8b1-6d3d307de32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2a31fa-a87b-468d-8e3b-5065c7b93903", "name": "network-vif-plugged", "status": "completed", "tag": "c40dae88-cb20-491c-85ea-9cf688dd1840"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:48.932310 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d5a9bb63-ab6c-4bda-8a6a-30de0ed280f3 req-1a2127c8-840c-42e5-a8b1-6d3d307de32e service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:48.932987 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d5a9bb63-ab6c-4bda-8a6a-30de0ed280f3 req-1a2127c8-840c-42e5-a8b1-6d3d307de32e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:48.934446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-d5a9bb63-ab6c-4bda-8a6a-30de0ed280f3 req-1a2127c8-840c-42e5-a8b1-6d3d307de32e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:48.949076 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-d5a9bb63-ab6c-4bda-8a6a-30de0ed280f3 req-1a2127c8-840c-42e5-a8b1-6d3d307de32e service nova] Creating event network-vif-plugged:c40dae88-cb20-491c-85ea-9cf688dd1840 for instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 on hv-cinder-83754 Aug 31 09:55:48.954724 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-d5a9bb63-ab6c-4bda-8a6a-30de0ed280f3 req-1a2127c8-840c-42e5-a8b1-6d3d307de32e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039883 Aug 31 09:55:48.955998 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 446/892] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:55:49.768934 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:49.769630 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:49.777821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.778446 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.778886 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:49.779609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:49.780407 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:49.781080 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:50.236517 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:50.257803 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:50.262133 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:50.265418 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8b956614-f826-4148-81c4-cb4cdc348c9e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.502465 Aug 31 09:55:50.271207 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 447/893] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:49 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:51.296936 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:51.297878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:51.314523 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:51.316166 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:51.317389 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:51.320843 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:51.321660 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:51.322425 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:51.685181 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:51.713045 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:51.715234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:51.716981 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d5dc417b-3037-4a1b-9236-9b475e5139a5 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1729 microversion: 2.20 time: 0.425362 Aug 31 09:55:51.717650 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 447/894] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:51 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1729 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:52.744556 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:52.745683 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:52.758276 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:52.758852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:52.760921 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:52.761912 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:52.762467 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:52.763825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:52.953779 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:52.966728 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:52.968752 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:52.970091 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-21312073-e528-43d0-916f-eebbd9ef5553 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1716 microversion: 2.20 time: 0.230978 Aug 31 09:55:52.970768 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 448/895] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:55:52 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1716 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:55:54.023872 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1993813283", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "networks": [{"uuid": "4c1dd663-6dd5-4f97-988c-8229b7247084"}]}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:54.096462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] validate_networks() for [('4c1dd663-6dd5-4f97-988c-8229b7247084', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:55:54.507841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:55:54.508436 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:55:54.508973 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:55:54.509483 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:55:54.509968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:55:54.519086 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:54.519596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:54.520046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:54.520764 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:54.521237 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:54.522586 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:54.539852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Getting quotas for project fbdd47c941404548bf5371c35e518346. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:55:54.543803 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Getting quotas for user 488e41d766134f3aa7c956816d01df06 and project fbdd47c941404548bf5371c35e518346. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:55:54.554771 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:55:54.557089 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:55:54.605096 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d2467a8c-c46c-427a-9166-dc71053e8f67 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586073 Aug 31 09:55:54.605847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 448/896] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:55:54.617228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3d57ffbe-29c0-431f-8d2f-17e99967bf90 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:54.617786 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3d57ffbe-29c0-431f-8d2f-17e99967bf90 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:54.695226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3d57ffbe-29c0-431f-8d2f-17e99967bf90 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:54.705363 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3d57ffbe-29c0-431f-8d2f-17e99967bf90 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1219 microversion: 2.1 time: 0.092130 Aug 31 09:55:54.705537 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 449/897] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:54 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:55.728816 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:55.729669 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:55.736830 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:55.737279 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:55.737680 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:55.738472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:55.738978 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:55.739466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:55.823471 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:55.831671 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ec90dcf0-dc43-4aca-ac18-32583cc68cfe tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1271 microversion: 2.1 time: 0.107588 Aug 31 09:55:55.832328 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 449/898] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:55 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:56.854995 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:56.856385 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:56.868574 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.869528 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.871017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:56.872795 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:56.873682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:56.874673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:57.016866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:57.026011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a457ab89-e1c8-4e15-94e6-dc19e3422ffc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1277 microversion: 2.1 time: 0.176703 Aug 31 09:55:57.026666 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 450/899] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:56 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:55:58.031369 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-867b71e4-75bc-44e1-8cfd-41ad5d9e43a3 req-ae5d8a63-3699-48eb-9786-574b1689cfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad113756-1fda-48ae-917e-120ee6283f4b", "tag": "493d5a96-6868-4be6-81f3-666ba446af9d"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:55:58.045353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-867b71e4-75bc-44e1-8cfd-41ad5d9e43a3 req-ae5d8a63-3699-48eb-9786-574b1689cfc6 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:58.046530 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-867b71e4-75bc-44e1-8cfd-41ad5d9e43a3 req-ae5d8a63-3699-48eb-9786-574b1689cfc6 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:58.047236 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-867b71e4-75bc-44e1-8cfd-41ad5d9e43a3 req-ae5d8a63-3699-48eb-9786-574b1689cfc6 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:58.049184 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:58.050139 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:58.063408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-867b71e4-75bc-44e1-8cfd-41ad5d9e43a3 req-ae5d8a63-3699-48eb-9786-574b1689cfc6 service nova] Creating event network-changed:493d5a96-6868-4be6-81f3-666ba446af9d for instance ad113756-1fda-48ae-917e-120ee6283f4b on hv-cinder-83754 Aug 31 09:55:58.070736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-867b71e4-75bc-44e1-8cfd-41ad5d9e43a3 req-ae5d8a63-3699-48eb-9786-574b1689cfc6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043150 Aug 31 09:55:58.072786 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 450/900] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:55:58.081539 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:58.082116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:58.082490 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:58.083250 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:58.084856 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:58.085320 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:58.241878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:58.252411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-58589461-15d3-4bda-a86b-cf92add2159d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.208617 Aug 31 09:55:58.253001 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 451/901] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:58 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:55:59.276269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:55:59.277050 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:55:59.286056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:59.291200 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:59.291200 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.291200 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:55:59.291200 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:55:59.291946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:55:59.496450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:55:59.506124 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7724f7cc-9db9-494e-9c1f-5173bebf5e6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.234888 Aug 31 09:55:59.506813 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 451/902] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:55:59 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:00.536170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:00.537113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:00.549253 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.549744 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.550179 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.550929 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:00.551415 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:00.551832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:00.715670 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:00.729235 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6b6de3df-db0b-4287-843a-4c875d8ee580 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.196840 Aug 31 09:56:00.730141 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 452/903] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:00 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:01.754666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:01.755886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:01.764094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:01.764686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:01.765326 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.766048 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:01.766680 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:01.766967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:01.915578 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:01.923523 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a09f4762-9287-4055-8b2d-09e0e0f9934d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.174017 Aug 31 09:56:01.923985 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 452/904] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:01 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:02.945597 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:02.946368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:02.953303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:02.953783 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:02.954214 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:02.954915 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:02.955398 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:02.955892 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:02.961313 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=87 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:03.124909 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:03.133894 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1594a6e7-b100-4ae2-8c14-b117b880ad63 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.192773 Aug 31 09:56:03.134484 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 453/905] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:02 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:04.156390 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:04.156996 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:04.163677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:04.164285 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:04.164750 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:04.165484 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:04.166072 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:04.166539 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:04.350427 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:04.362944 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3534f6f1-2a55-47a5-81a9-8a45b32d9c3d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.210317 Aug 31 09:56:04.363952 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 453/906] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:04 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:04.638210 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-0404d5c7-8e22-47a7-822b-d8914fcc66d9 req-a57f8890-69d6-493a-b73e-f7ed2d66dda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad113756-1fda-48ae-917e-120ee6283f4b", "name": "network-vif-plugged", "status": "completed", "tag": "493d5a96-6868-4be6-81f3-666ba446af9d"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:04.656163 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-0404d5c7-8e22-47a7-822b-d8914fcc66d9 req-a57f8890-69d6-493a-b73e-f7ed2d66dda6 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:04.657244 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-0404d5c7-8e22-47a7-822b-d8914fcc66d9 req-a57f8890-69d6-493a-b73e-f7ed2d66dda6 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:04.658352 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-0404d5c7-8e22-47a7-822b-d8914fcc66d9 req-a57f8890-69d6-493a-b73e-f7ed2d66dda6 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:04.680971 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-0404d5c7-8e22-47a7-822b-d8914fcc66d9 req-a57f8890-69d6-493a-b73e-f7ed2d66dda6 service nova] Creating event network-vif-plugged:493d5a96-6868-4be6-81f3-666ba446af9d for instance ad113756-1fda-48ae-917e-120ee6283f4b on hv-cinder-83754 Aug 31 09:56:04.691042 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-0404d5c7-8e22-47a7-822b-d8914fcc66d9 req-a57f8890-69d6-493a-b73e-f7ed2d66dda6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056996 Aug 31 09:56:04.693744 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 454/907] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:05.385577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:05.386196 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:05.388187 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:05.388847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=6 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:05.395520 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:05.396601 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:05.397018 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:05.397736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:05.398344 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:05.398905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:05.554072 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:05.562703 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-cab400ff-cbd1-4eae-8c6d-42637314ef6c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.180851 Aug 31 09:56:05.563328 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 454/908] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:05 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:06.595298 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:06.600897 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:06.601593 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:06.608562 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:06.609233 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:06.609732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:06.610693 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:06.611204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:06.611944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:06.756821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:06.768953 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e647c255-92b7-43a0-aebc-970f915a2436 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.174156 Aug 31 09:56:06.770008 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 455/909] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:06 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:07.805290 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:07.805897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:07.812834 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:07.813327 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:07.813762 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:07.814483 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:07.814937 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:07.815403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:07.969973 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:07.979229 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a62e88d1-2e3c-48de-80fd-775b0c918abc tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.179125 Aug 31 09:56:07.979821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 455/910] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:07 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:09.003402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:09.004583 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:09.012768 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:09.013478 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:09.013704 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:09.014402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:09.014940 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:09.015866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:09.186027 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:09.196867 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c7a2c9bb-5ca3-4cc7-92ea-e6ddc7501870 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1319 microversion: 2.1 time: 0.197649 Aug 31 09:56:09.197846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 456/911] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:08 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:10.227315 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:10.228011 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:10.235543 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:10.236117 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:10.236613 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:10.237500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:10.238110 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:10.238723 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:10.402162 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:10.419797 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2a7a9b41-b6d7-47cc-a4e0-9338495f59c3 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1508 microversion: 2.1 time: 0.197171 Aug 31 09:56:10.421027 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 456/912] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:10 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:56:31.460769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8eec44e3-c47f-4de5-9e95-4e4ab090ccef tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "649b88d8-b692-4dbc-a66d-4ea4b28d19ad", "device": "/dev/sdb"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:31.463873 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8eec44e3-c47f-4de5-9e95-4e4ab090ccef tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:31.466546 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=25 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:31.467210 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=19 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:31.472723 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8eec44e3-c47f-4de5-9e95-4e4ab090ccef tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:31.473296 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8eec44e3-c47f-4de5-9e95-4e4ab090ccef tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:31.473723 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8eec44e3-c47f-4de5-9e95-4e4ab090ccef tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:31.474579 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8eec44e3-c47f-4de5-9e95-4e4ab090ccef tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:31.475025 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8eec44e3-c47f-4de5-9e95-4e4ab090ccef tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:31.475475 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8eec44e3-c47f-4de5-9e95-4e4ab090ccef tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:31.772056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8eec44e3-c47f-4de5-9e95-4e4ab090ccef tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "POST /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314993 Aug 31 09:56:31.772722 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 457/913] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:56:31 2022] POST /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:32.233569 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-079a930c-673d-4be5-80e0-4c155edf18a0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:32.236108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-079a930c-673d-4be5-80e0-4c155edf18a0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:32.239963 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:32.240571 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=73 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:32.245751 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-079a930c-673d-4be5-80e0-4c155edf18a0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.246248 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-079a930c-673d-4be5-80e0-4c155edf18a0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.246684 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-079a930c-673d-4be5-80e0-4c155edf18a0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.247455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-079a930c-673d-4be5-80e0-4c155edf18a0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.247923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-079a930c-673d-4be5-80e0-4c155edf18a0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.248353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-079a930c-673d-4be5-80e0-4c155edf18a0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.302564 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-079a930c-673d-4be5-80e0-4c155edf18a0 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.076933 Aug 31 09:56:32.303638 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 457/914] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Aug 31 09:56:32 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:32.374573 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:32.375221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:32.382356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.382842 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.383324 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.384097 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.384550 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.384976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.418342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:56:32.554628 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6440f3fa-21d9-4010-8abe-9c40912714c2 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 204 len: 0 microversion: 2.20 time: 0.184688 Aug 31 09:56:32.562125 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 458/915] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Aug 31 09:56:32 2022] DELETE /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 09:56:32.569277 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:32.570269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:32.580554 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.584157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.584732 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.585760 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:32.586968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:32.587548 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:32.647252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-316415160", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-790377107", "security_groups": [{"name": "tempest-secgroup-smoke-817822166"}], "block_device_mapping_v2": [{"uuid": "1d95c215-98e2-4409-b178-ae2c144bd02c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c93cbb45-31b4-4c55-8a58-3426eb15ee6e"}]}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:32.780142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:32.789595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:32.791056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:32.792343 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f12f3b6c-897e-4786-8674-76637beadabd tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.228330 Aug 31 09:56:32.792853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 458/916] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:32 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:56:32.966586 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.network.neutron [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] validate_networks() for [('c93cbb45-31b4-4c55-8a58-3426eb15ee6e', None, None, None, None, None)] {{(pid=132570) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:56:33.494038 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Flavor limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:56:33.494838 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Image limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:56:33.495364 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Flavor pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:56:33.495782 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Image pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:56:33.496585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:56:33.512340 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:33.513027 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:33.513609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:33.514492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:33.515160 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:33.515897 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:33.539894 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Getting quotas for project 9f1c2adbca494a53a24033b674c2762c. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:56:33.544919 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Getting quotas for user 893e06c5ea99497fae2847399b7a1a3c and project 9f1c2adbca494a53a24033b674c2762c. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:56:33.623607 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Going to run 1 instances... {{(pid=132570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:56:33.626855 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1d95c215-98e2-4409-b178-ae2c144bd02c',volume_size=None,volume_type=None)] {{(pid=132570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:56:33.812181 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7d1328f7-b197-4544-a206-10147d240509 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.170653 Aug 31 09:56:33.813476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 459/917] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:56:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 09:56:33.815770 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:33.816882 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:33.827105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:33.828372 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:33.829888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-58581c9d-d297-4dc9-9af1-60285943a9e7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:33.830982 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:33.831221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-58581c9d-d297-4dc9-9af1-60285943a9e7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:33.833587 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:33.834745 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:33.837271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:33.933696 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-58581c9d-d297-4dc9-9af1-60285943a9e7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:33.945860 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-58581c9d-d297-4dc9-9af1-60285943a9e7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1093 microversion: 2.1 time: 0.123472 Aug 31 09:56:33.947382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 460/918] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:33 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1093 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:34.176885 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:34.189090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:34.190876 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:34.194105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-efe92ab4-6319-4521-91b0-c8a1f98ec41e tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1722 microversion: 2.20 time: 0.382155 Aug 31 09:56:34.195401 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 459/919] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:33 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1722 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 09:56:34.971460 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:34.972488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:34.991886 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:34.992633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:34.993247 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:34.994151 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:34.995102 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:34.996000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.112302 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:35.131244 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-505b6263-0c2e-4ca3-85ca-420a1a275179 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1191 microversion: 2.1 time: 0.165867 Aug 31 09:56:35.132185 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 461/920] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:34 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1191 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:35.227690 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:35.229848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:35.239115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.240005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.240815 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.242619 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.243572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.244208 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.384686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:35.398075 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:35.399850 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:35.401217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-88b7751e-7d96-47bf-9f5b-7fc7e88d1e76 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1655 microversion: 2.20 time: 0.178994 Aug 31 09:56:35.401972 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 460/921] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:35 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1655 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:35.636492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-67c7040c-9b60-4b94-b63e-dd14c3e1ad3e req-34ba964a-1d21-4933-a51d-d953c866d443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2a31fa-a87b-468d-8e3b-5065c7b93903", "name": "network-vif-deleted", "tag": "c40dae88-cb20-491c-85ea-9cf688dd1840"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:35.649512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-67c7040c-9b60-4b94-b63e-dd14c3e1ad3e req-34ba964a-1d21-4933-a51d-d953c866d443 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:35.650254 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-67c7040c-9b60-4b94-b63e-dd14c3e1ad3e req-34ba964a-1d21-4933-a51d-d953c866d443 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:35.650792 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-67c7040c-9b60-4b94-b63e-dd14c3e1ad3e req-34ba964a-1d21-4933-a51d-d953c866d443 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:35.672970 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-67c7040c-9b60-4b94-b63e-dd14c3e1ad3e req-34ba964a-1d21-4933-a51d-d953c866d443 service nova] Creating event network-vif-deleted:c40dae88-cb20-491c-85ea-9cf688dd1840 for instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 on hv-cinder-83754 Aug 31 09:56:35.683901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-67c7040c-9b60-4b94-b63e-dd14c3e1ad3e req-34ba964a-1d21-4933-a51d-d953c866d443 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051505 Aug 31 09:56:35.685132 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 462/922] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:36.164551 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:36.165452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:36.182456 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:36.182954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:36.183581 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.184115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:36.184563 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:36.184980 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.284755 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:36.296577 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a62a8571-f060-4528-84d4-da6420b18e5d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1209 microversion: 2.1 time: 0.136226 Aug 31 09:56:36.297534 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 461/923] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:36 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1209 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:36.433928 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:36.436179 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:36.448092 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:36.448917 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:36.449553 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.451407 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:36.452821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:36.453470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.516622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:36.517846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:36.518492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:36.520289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lazy-loading 'fault' on Instance uuid cb2a31fa-a87b-468d-8e3b-5065c7b93903 {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:56:36.622080 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:36.643386 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:36.646611 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eecdfed8cc44f685095b6a70a4e69d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a8edca05bf4490948bb10b390bb373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:36.648486 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-60c8c2d5-dcaf-4cba-a498-fb5d47ae4390 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 200 len: 1371 microversion: 2.20 time: 0.224457 Aug 31 09:56:36.649852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 463/924] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:36 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 09:56:37.319719 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:37.320974 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:37.329136 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.329760 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.330304 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.331051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.331547 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.331977 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.607195 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:37.616891 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0a76f467-028b-4ff5-b0f9-a2873b909fc4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1276 microversion: 2.1 time: 0.301926 Aug 31 09:56:37.617125 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 462/925] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:37 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1276 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:37.674257 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:37.674828 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:37.682587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.683311 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.683776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.684469 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.684949 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.685370 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.700690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] HTTP exception thrown: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Request method failure captured: Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 HTTP/1.1 Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy7Qq4mv9He1X6Syp6obkbBZ_BC3Qi-hWTnsEqDWAP9P57nB_U9Moz50gB3wPiPWDmZX15J1NO8wKWTKqk_WZDygLr6B-tlpQgX4EirgitkzndvdGAy11HgtNXAxbaIZ--RKy04MV58H6hhHL_lfIKZz_MXndlH4199Bk0CgHv14Q9A Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:56:37.702547 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_40a8edca05bf4490948bb10b390bb373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 18eecdfed8cc44f685095b6a70a4e69d Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:37.704170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'cb2a31fa-a87b-468d-8e3b-5065c7b93903'} Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:37.705616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:37.708609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:37.711619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Returning 404 to user: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:37.711619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-728ecf3e-1bdd-4041-b2f0-b7a69826366b tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 404 len: 111 microversion: 2.20 time: 0.034040 Aug 31 09:56:37.711619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 464/926] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:37 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:56:37.712272 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-fbaad833-f761-4770-b314-1e3c1d32aa87 req-9c24866f-1b84-4dfb-8fc0-d1fefc0648c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c0db77-8866-4dd0-9546-cdb48ce54f5b", "tag": "68354a65-9e07-4517-8ae7-88995bfb7479"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:37.713069 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a75d6a2d-8051-471e-aafa-d8a2e8dfa371 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '.version_select at 0x7f9462ae7550>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:37.724776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-fbaad833-f761-4770-b314-1e3c1d32aa87 req-9c24866f-1b84-4dfb-8fc0-d1fefc0648c3 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:37.725241 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-fbaad833-f761-4770-b314-1e3c1d32aa87 req-9c24866f-1b84-4dfb-8fc0-d1fefc0648c3 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:37.725674 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-fbaad833-f761-4770-b314-1e3c1d32aa87 req-9c24866f-1b84-4dfb-8fc0-d1fefc0648c3 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:37.739619 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-fbaad833-f761-4770-b314-1e3c1d32aa87 req-9c24866f-1b84-4dfb-8fc0-d1fefc0648c3 service nova] Creating event network-changed:68354a65-9e07-4517-8ae7-88995bfb7479 for instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b on hv-cinder-83754 Aug 31 09:56:37.740166 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a75d6a2d-8051-471e-aafa-d8a2e8dfa371 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084512676" status: 204 len: 0 microversion: 2.20 time: 0.030390 Aug 31 09:56:37.741969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 465/927] 10.222.0.36 () {60 vars in 1262 bytes} [Wed Aug 31 09:56:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1084512676 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 09:56:37.745452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-fbaad833-f761-4770-b314-1e3c1d32aa87 req-9c24866f-1b84-4dfb-8fc0-d1fefc0648c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037150 Aug 31 09:56:37.747247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 463/928] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:56:38.638853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:38.639831 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:38.648343 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:38.648894 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:38.649491 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:38.650389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:38.650840 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:38.651485 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:38.798966 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:38.807292 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c2651a70-1e09-4dad-9dc0-ad9a62944514 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1276 microversion: 2.1 time: 0.173237 Aug 31 09:56:38.807863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 466/929] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:38 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:39.699654 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:39.700236 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:39.706292 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.706780 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.707970 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.708867 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.709320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.709744 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.723768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] HTTP exception thrown: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Request method failure captured: Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: DELETE /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 HTTP/1.1 Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy7Qq4mv9He1X6Syp6obkbBZ_BC3Qi-hWTnsEqDWAP9P57nB_U9Moz50gB3wPiPWDmZX15J1NO8wKWTKqk_WZDygLr6B-tlpQgX4EirgitkzndvdGAy11HgtNXAxbaIZ--RKy04MV58H6hhHL_lfIKZz_MXndlH4199Bk0CgHv14Q9A Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:56:39.725438 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_40a8edca05bf4490948bb10b390bb373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 18eecdfed8cc44f685095b6a70a4e69d Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.727185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'cb2a31fa-a87b-468d-8e3b-5065c7b93903'} Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:39.728257 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.730061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.732056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Returning 404 to user: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:39.732056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fedf93b3-474b-48e4-9e44-77cfdf4fb223 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 404 len: 111 microversion: 2.20 time: 0.031912 Aug 31 09:56:39.732056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 464/930] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Aug 31 09:56:39 2022] DELETE /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:56:39.736058 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:39.737201 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: cb2a31fa-a87b-468d-8e3b-5065c7b93903] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:39.747855 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.748342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.748772 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.749483 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.750572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.752495 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.774030 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] HTTP exception thrown: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Request method failure captured: Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 HTTP/1.1 Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy7Qq4mv9He1X6Syp6obkbBZ_BC3Qi-hWTnsEqDWAP9P57nB_U9Moz50gB3wPiPWDmZX15J1NO8wKWTKqk_WZDygLr6B-tlpQgX4EirgitkzndvdGAy11HgtNXAxbaIZ--RKy04MV58H6hhHL_lfIKZz_MXndlH4199Bk0CgHv14Q9A Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:56:39.776769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_40a8edca05bf4490948bb10b390bb373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 18eecdfed8cc44f685095b6a70a4e69d Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.778466 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'cb2a31fa-a87b-468d-8e3b-5065c7b93903'} Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:39.779391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. Aug 31 09:56:39.780820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:39.782241 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Returning 404 to user: Instance cb2a31fa-a87b-468d-8e3b-5065c7b93903 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:39.782241 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ef6ed07c-8a64-4af8-889c-89b47df68147 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903" status: 404 len: 111 microversion: 2.20 time: 0.047346 Aug 31 09:56:39.782241 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 467/931] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:39 2022] GET /compute/v2.1/servers/cb2a31fa-a87b-468d-8e3b-5065c7b93903 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:56:39.831002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:39.831671 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:39.838624 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.839015 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.839490 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:39.843232 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:39.843232 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:39.843232 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.008408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:40.016157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bc106250-16d4-4da6-820f-45b7c48e374f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1276 microversion: 2.1 time: 0.189918 Aug 31 09:56:40.016717 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 465/932] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:39 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:40.954951 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:40.956113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:40.962906 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.963511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.963956 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.964658 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:40.965116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:40.965571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:40.980571 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] HTTP exception thrown: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Request method failure captured: Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: DELETE /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d HTTP/1.1 Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy7Qq4mv9He1X6Syp6obkbBZ_BC3Qi-hWTnsEqDWAP9P57nB_U9Moz50gB3wPiPWDmZX15J1NO8wKWTKqk_WZDygLr6B-tlpQgX4EirgitkzndvdGAy11HgtNXAxbaIZ--RKy04MV58H6hhHL_lfIKZz_MXndlH4199Bk0CgHv14Q9A Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:56:40.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_40a8edca05bf4490948bb10b390bb373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 18eecdfed8cc44f685095b6a70a4e69d Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:40.983686 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'e2236114-93d1-4533-8199-e77b5996f54d'} Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:40.984434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:40.985654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:56:40.988032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Returning 404 to user: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:40.988032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-78dccf51-3071-4f4a-8294-a7168f0659df tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 404 len: 111 microversion: 2.20 time: 0.032515 Aug 31 09:56:40.988032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 468/933] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Aug 31 09:56:40 2022] DELETE /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:56:40.994718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:40.995366 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] [instance: e2236114-93d1-4533-8199-e77b5996f54d] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:41.002351 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.002841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.003335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.004109 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.004735 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.005148 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.018928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] HTTP exception thrown: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Request method failure captured: Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d HTTP/1.1 Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy7Qq4mv9He1X6Syp6obkbBZ_BC3Qi-hWTnsEqDWAP9P57nB_U9Moz50gB3wPiPWDmZX15J1NO8wKWTKqk_WZDygLr6B-tlpQgX4EirgitkzndvdGAy11HgtNXAxbaIZ--RKy04MV58H6hhHL_lfIKZz_MXndlH4199Bk0CgHv14Q9A Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:56:41.020617 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_40a8edca05bf4490948bb10b390bb373"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/40a8edca05bf4490948bb10b390bb373"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 40a8edca05bf4490948bb10b390bb373 Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1662836453 Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 18eecdfed8cc44f685095b6a70a4e69d Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1662836453-project Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:41.022514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'e2236114-93d1-4533-8199-e77b5996f54d'} Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:56:41.023540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. Aug 31 09:56:41.024967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:56:41.026462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] Returning 404 to user: Instance e2236114-93d1-4533-8199-e77b5996f54d could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:56:41.026462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-0298bd81-7a47-4431-9f40-08672d53e961 tempest-AttachVolumeShelveTestJSON-1662836453 tempest-AttachVolumeShelveTestJSON-1662836453-project] 10.222.0.36 "GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d" status: 404 len: 111 microversion: 2.20 time: 0.033806 Aug 31 09:56:41.026462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 466/934] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Aug 31 09:56:40 2022] GET /compute/v2.1/servers/e2236114-93d1-4533-8199-e77b5996f54d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 09:56:41.038220 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:41.038827 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:41.045182 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.045572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.045998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.046692 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:41.047554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:41.047742 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:41.193932 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:41.201507 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c7054694-6c6b-466b-99d6-59e84abfe165 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.167612 Aug 31 09:56:41.202074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 469/935] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:41 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:42.223917 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:42.224642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:42.232145 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:42.232830 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:42.233343 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:42.234157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:42.234618 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:42.235079 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:42.396157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:42.404301 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e09b7e2a-b509-4f7e-bff2-79803b84bccf tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.184889 Aug 31 09:56:42.404890 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 467/936] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:42 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:43.427256 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:43.428984 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:43.436044 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.436539 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.436975 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.437681 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:43.438129 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:43.438562 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:43.527776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:43.759619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:43.767786 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2b47b88e-4ec3-4aeb-9845-2f5a1cfcafd9 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.345603 Aug 31 09:56:43.768375 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 470/937] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:43 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:44.794593 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:44.795240 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:44.804173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.804881 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.805321 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:44.806792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:44.811021 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:44.811630 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:45.316112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:45.326777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3f11c364-27af-42b4-8635-9181ed40fc07 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.539537 Aug 31 09:56:45.327511 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 468/938] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:44 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:46.349880 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:46.350740 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:46.356751 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=8 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:46.359004 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.359524 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.359956 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:46.360648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:46.361092 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:46.361509 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:46.521167 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:46.529078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-849c6bf0-4791-4d3e-9213-e7ad44749d6e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.183381 Aug 31 09:56:46.529845 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 471/939] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:46 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:47.549718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:47.550330 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:47.557518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:47.558013 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:47.558464 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:47.559194 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:47.559657 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:47.560115 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:47.702274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:47.710337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2c6ea887-e332-4393-835f-35efe1a28e9e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.164471 Aug 31 09:56:47.710905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 469/940] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:47 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:48.731530 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:48.732219 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:48.738566 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.739048 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.739510 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.740200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:48.740647 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:48.741061 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:48.880054 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:48.887739 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-bec9eedc-ef4e-43f5-b261-b8076f374c5e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.160074 Aug 31 09:56:48.888309 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 472/941] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:48 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:49.908725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:49.909355 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:49.916449 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:49.916938 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:49.917674 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:49.918087 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:49.918543 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:49.918973 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:50.063094 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:50.071111 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1a1876cd-cc5c-47c4-97d7-5fdac623b712 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.166196 Aug 31 09:56:50.071716 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 470/942] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:49 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:51.091823 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:51.092437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:51.099606 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.100105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.100541 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.101261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:51.101718 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:51.102164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:51.243972 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:51.253980 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-24d8a104-f471-4700-a8c1-dadc4a0db504 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.165489 Aug 31 09:56:51.257066 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 473/943] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:51 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:52.279394 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:52.280105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:52.288396 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:52.288887 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:52.289322 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:52.290026 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:52.290481 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:52.290904 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:52.426994 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:52.434745 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fdf44818-d1fe-4451-989e-bc8413415858 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.159970 Aug 31 09:56:52.435335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 471/944] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:52 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:53.455835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:53.456505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:53.463629 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:53.464116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:53.464550 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:53.465240 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:53.465694 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:53.466116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:53.606171 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:53.614944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9222920f-77fe-4a7e-9556-223b83838a14 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.162915 Aug 31 09:56:53.615884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 474/945] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:53 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:54.636353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:54.637000 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:54.643397 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:54.643916 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:54.644439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:54.645135 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:54.646107 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:54.646525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:54.790134 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:54.798126 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fb42b44b-71d4-4ad8-a8cd-6daa2e04336d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.165694 Aug 31 09:56:54.798873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 472/946] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:54 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:55.819203 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:55.819829 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:55.826138 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:55.826661 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:55.827105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:55.827824 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:55.828370 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:55.828687 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:55.847910 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:55.967231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:55.975149 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-36ce02c8-37a6-4792-8680-74150e87cfce tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.160447 Aug 31 09:56:55.975727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 475/947] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:55 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:56.996091 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:56.996696 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:57.004088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:57.004574 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:57.005004 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:57.005694 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:57.006142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:57.006574 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:57.141706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:57.149886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b3f4f127-8d1e-4dff-a4d4-b8976a439f47 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.157982 Aug 31 09:56:57.150469 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 473/948] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:56 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:58.170688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:58.171482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:58.180795 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:58.181510 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:58.182164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:58.182945 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:58.183492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:58.183915 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:58.335930 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:58.344303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f941c23f-71ca-455f-81ce-357c37eaf4be tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.177334 Aug 31 09:56:58.344809 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 476/949] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:58 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:56:59.310641 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-8df6f8c5-1cea-45e3-9931-d1a33dc83d81 req-1fe4d35a-261c-4079-afcc-f456c577a063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c0db77-8866-4dd0-9546-cdb48ce54f5b", "name": "network-vif-plugged", "status": "completed", "tag": "68354a65-9e07-4517-8ae7-88995bfb7479"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:56:59.320873 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-8df6f8c5-1cea-45e3-9931-d1a33dc83d81 req-1fe4d35a-261c-4079-afcc-f456c577a063 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:59.321358 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-8df6f8c5-1cea-45e3-9931-d1a33dc83d81 req-1fe4d35a-261c-4079-afcc-f456c577a063 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:59.321808 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-8df6f8c5-1cea-45e3-9931-d1a33dc83d81 req-1fe4d35a-261c-4079-afcc-f456c577a063 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:59.338037 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-8df6f8c5-1cea-45e3-9931-d1a33dc83d81 req-1fe4d35a-261c-4079-afcc-f456c577a063 service nova] Creating event network-vif-plugged:68354a65-9e07-4517-8ae7-88995bfb7479 for instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b on hv-cinder-83754 Aug 31 09:56:59.344247 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-8df6f8c5-1cea-45e3-9931-d1a33dc83d81 req-1fe4d35a-261c-4079-afcc-f456c577a063 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037141 Aug 31 09:56:59.344857 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 474/950] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:56:59.365805 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:56:59.367494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:56:59.374081 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:59.374631 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:59.374991 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:59.375711 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:56:59.376160 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:56:59.376578 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:56:59.521896 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:56:59.531215 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2e5c568c-3ced-4dd4-87cc-a474b4e21dc8 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.169004 Aug 31 09:56:59.531855 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 477/951] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:56:59 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:00.054752 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:00.055580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:00.064251 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:00.064912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:00.065371 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:00.066188 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:00.066672 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:00.067096 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:00.157556 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lazy-loading 'services' on Instance uuid ad113756-1fda-48ae-917e-120ee6283f4b {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:57:00.161246 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=100 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:00.238804 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e575a4f1-b3a0-4aa9-926f-dc9e5c68f686 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b/os-volume_attachments/649b88d8-b692-4dbc-a66d-4ea4b28d19ad" status: 202 len: 0 microversion: 2.1 time: 0.188620 Aug 31 09:57:00.239705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 475/952] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:57:00 2022] DELETE /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b/os-volume_attachments/649b88d8-b692-4dbc-a66d-4ea4b28d19ad => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:57:00.558335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:00.558948 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:00.565484 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:00.566006 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:00.566446 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:00.567214 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:00.567679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:00.568101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:00.707509 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:00.715280 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ca0a2af5-e118-4117-a9a7-ddc20f66d819 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1264 microversion: 2.1 time: 0.161315 Aug 31 09:57:00.715866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 478/953] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:00 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:01.745305 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:01.746019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:01.752578 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:01.753185 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:01.753812 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:01.754686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:01.755350 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:01.756179 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:01.931586 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:01.940030 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1483c0aa-af1c-4f28-a9dc-3915e74bf973 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1451 microversion: 2.1 time: 0.206840 Aug 31 09:57:01.940612 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 476/954] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:01 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1451 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:57:01.961888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:01.962918 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:01.965342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:01.970908 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:01.971720 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:01.972525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:01.973525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:01.974143 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:01.974742 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:02.126371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:02.136049 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2a7363b8-4ff9-4822-828e-f3dce2526623 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1451 microversion: 2.1 time: 0.178797 Aug 31 09:57:02.136642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 479/955] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:01 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:02.443575 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:02.444325 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:02.449712 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=41 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:02.454038 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:02.454755 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:02.455392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:02.456090 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:02.456537 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:02.456952 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:02.494415 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Going to try to terminate instance {{(pid=132571) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:57:02.612906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-56a893e0-f422-4e0f-9d0e-c7d00ed51380 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 204 len: 0 microversion: 2.1 time: 0.173014 Aug 31 09:57:02.613845 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 477/956] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:57:02 2022] DELETE /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:57:02.624030 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:02.624848 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:02.638016 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:02.638837 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:02.639830 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:02.640941 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:02.641749 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:02.642506 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:02.885936 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:02.894843 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-976bea35-8a74-444f-aa2a-240f4aec0d05 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1514 microversion: 2.1 time: 0.275707 Aug 31 09:57:02.895825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 480/957] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:02 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:03.918356 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:03.919872 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:03.924110 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 09:57:03.924270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Wed Aug 31 09:57:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b (ip 10.222.0.36) !!! Aug 31 09:57:03.931423 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:03.931923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:03.932354 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:03.933074 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:03.933530 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:03.933958 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:04.091520 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:04.100895 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7b07d19b-393a-4101-a4ac-3772f38350f4 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1514 microversion: 2.1 time: 0.188361 Aug 31 09:57:04.111607 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 478/958] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:03 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:57:04.557226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-ccd4ccdf-01fe-482b-9889-734f90cf63b6 req-60fdf533-eb4e-4686-b618-e5cd4c192063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c0db77-8866-4dd0-9546-cdb48ce54f5b", "tag": "68354a65-9e07-4517-8ae7-88995bfb7479"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:04.567346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-ccd4ccdf-01fe-482b-9889-734f90cf63b6 req-60fdf533-eb4e-4686-b618-e5cd4c192063 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:04.567905 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-ccd4ccdf-01fe-482b-9889-734f90cf63b6 req-60fdf533-eb4e-4686-b618-e5cd4c192063 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:04.568368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-ccd4ccdf-01fe-482b-9889-734f90cf63b6 req-60fdf533-eb4e-4686-b618-e5cd4c192063 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:04.580342 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-ccd4ccdf-01fe-482b-9889-734f90cf63b6 req-60fdf533-eb4e-4686-b618-e5cd4c192063 service nova] Creating event network-changed:68354a65-9e07-4517-8ae7-88995bfb7479 for instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b on hv-cinder-83754 Aug 31 09:57:04.585700 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-ccd4ccdf-01fe-482b-9889-734f90cf63b6 req-60fdf533-eb4e-4686-b618-e5cd4c192063 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032742 Aug 31 09:57:04.587111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 481/959] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:05.122176 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:05.122795 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:05.129403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:05.129933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:05.130377 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:05.131083 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:05.131568 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:05.132002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:05.270925 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:05.279822 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3967b306-31c7-4331-a3d9-dbd031b76c58 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1514 microversion: 2.1 time: 0.161718 Aug 31 09:57:05.280412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 479/960] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:05 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:06.302183 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:06.302880 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:06.310672 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:06.311184 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:06.311624 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:06.312587 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:06.312786 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:06.313253 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:06.449784 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:06.457638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-b901cde3-69f2-4322-90dc-3db5d8876f6b tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1514 microversion: 2.1 time: 0.159735 Aug 31 09:57:06.465171 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 482/961] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:06 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:07.478950 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:07.479666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:07.486053 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:07.486540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:07.487184 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:07.487894 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:07.488351 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:07.488788 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:07.700682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-a403f5c0-8297-4dfe-bbcd-0f4fa99b81b3 req-ad3a0567-cd64-4505-b7bb-2a8c5a351e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad113756-1fda-48ae-917e-120ee6283f4b", "name": "network-vif-deleted", "tag": "493d5a96-6868-4be6-81f3-666ba446af9d"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:07.715673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-a403f5c0-8297-4dfe-bbcd-0f4fa99b81b3 req-ad3a0567-cd64-4505-b7bb-2a8c5a351e07 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:07.716834 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-a403f5c0-8297-4dfe-bbcd-0f4fa99b81b3 req-ad3a0567-cd64-4505-b7bb-2a8c5a351e07 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:07.717660 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-a403f5c0-8297-4dfe-bbcd-0f4fa99b81b3 req-ad3a0567-cd64-4505-b7bb-2a8c5a351e07 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:07.744431 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:07.749800 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-a403f5c0-8297-4dfe-bbcd-0f4fa99b81b3 req-ad3a0567-cd64-4505-b7bb-2a8c5a351e07 service nova] Creating event network-vif-deleted:493d5a96-6868-4be6-81f3-666ba446af9d for instance ad113756-1fda-48ae-917e-120ee6283f4b on hv-cinder-83754 Aug 31 09:57:07.757068 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7136c9e5-1daf-4d2a-955d-9a252846b2ba tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1514 microversion: 2.1 time: 0.282299 Aug 31 09:57:07.758395 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-a403f5c0-8297-4dfe-bbcd-0f4fa99b81b3 req-ad3a0567-cd64-4505-b7bb-2a8c5a351e07 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062286 Aug 31 09:57:07.759535 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 480/962] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:07 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:07.763582 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 483/963] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:57:08.780380 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:08.780991 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:08.787414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:08.787906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:08.788340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:08.789623 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:08.790088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:08.790514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:08.824229 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:08.824986 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:08.825422 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:08.825877 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lazy-loading 'fault' on Instance uuid ad113756-1fda-48ae-917e-120ee6283f4b {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:57:08.871113 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:08.878061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-308b97a0-4a99-422f-b503-c4a686481b6d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 200 len: 1309 microversion: 2.1 time: 0.101648 Aug 31 09:57:08.878625 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 481/964] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:08 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:09.901090 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:09.901702 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: ad113756-1fda-48ae-917e-120ee6283f4b] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:09.907869 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:09.908309 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:09.908741 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:09.909431 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:09.909883 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:09.910301 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:09.926374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] HTTP exception thrown: Instance ad113756-1fda-48ae-917e-120ee6283f4b could not be found. Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Request method failure captured: Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b HTTP/1.1 Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDzAodDVEJOhof8lE3o1GTCsxfL6scELBmcapKfQAgJoggwVs90EeWoqDO5rUobiic5pyRhyIjWOaZ4K115022h6X2RK9ycjOPyQaR4IyNZ_ho3EzvJK8K90G3gTSG3dYzQKFni8aRj5lyeWq1tvLHxODa4eCnFyIrsl1Qqs0NflTAQ0 Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: fbdd47c941404548bf5371c35e518346 Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-VolumesSnapshotTestJSON-390608872 Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:57:09.928023 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fbdd47c941404548bf5371c35e518346"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fbdd47c941404548bf5371c35e518346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fbdd47c941404548bf5371c35e518346"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fbdd47c941404548bf5371c35e518346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-VolumesSnapshotTestJSON-390608872 Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: fbdd47c941404548bf5371c35e518346 Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-390608872 Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-VolumesSnapshotTestJSON-390608872-project Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 488e41d766134f3aa7c956816d01df06 Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-VolumesSnapshotTestJSON-390608872-project Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance ad113756-1fda-48ae-917e-120ee6283f4b could not be found. Aug 31 09:57:09.929806 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'ad113756-1fda-48ae-917e-120ee6283f4b'} Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad113756-1fda-48ae-917e-120ee6283f4b could not be found. Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:57:09.930688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad113756-1fda-48ae-917e-120ee6283f4b could not be found. Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad113756-1fda-48ae-917e-120ee6283f4b could not be found. Aug 31 09:57:09.932281 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:57:09.933727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Returning 404 to user: Instance ad113756-1fda-48ae-917e-120ee6283f4b could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:57:09.933727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8ec54b8a-164b-4df0-bae7-1acc21fa401d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b" status: 404 len: 111 microversion: 2.1 time: 0.033770 Aug 31 09:57:09.933727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 484/965] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:09 2022] GET /compute/v2.1/servers/ad113756-1fda-48ae-917e-120ee6283f4b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:57:21.925855 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:21.926749 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:21.932658 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1131725519", "imageRef": "8f175fa3-e2f6-4f0f-a5b5-9616585b9a97", "flavorRef": "452", "networks": [{"uuid": "4c1dd663-6dd5-4f97-988c-8229b7247084"}]}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:22.002689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.network.neutron [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] validate_networks() for [('4c1dd663-6dd5-4f97-988c-8229b7247084', None, None, None, None, None)] {{(pid=132571) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:57:22.381119 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Flavor limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:57:22.381572 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Image limits 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:57:22.382553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Flavor pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:57:22.382966 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Image pref 0:0:0 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:57:22.383426 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.virt.hardware [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132571) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:57:22.392734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:22.393338 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:22.393805 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:22.394522 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:22.394972 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:22.395412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:22.415335 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Getting quotas for project fbdd47c941404548bf5371c35e518346. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:57:22.421016 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Getting quotas for user 488e41d766134f3aa7c956816d01df06 and project fbdd47c941404548bf5371c35e518346. Resources: {'cores', 'ram', 'instances'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:57:22.435066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Going to run 1 instances... {{(pid=132571) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:57:22.437375 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8f175fa3-e2f6-4f0f-a5b5-9616585b9a97',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132571) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:57:22.489102 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ed3b972f-3c73-4bfd-868d-13a4b2d2f305 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564414 Aug 31 09:57:22.489759 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 482/966] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:57:22.502812 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8d237902-700c-4a6a-826b-edcedb240c64 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:22.503450 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8d237902-700c-4a6a-826b-edcedb240c64 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:22.506994 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=11 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:22.508078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=44 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:22.612193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8d237902-700c-4a6a-826b-edcedb240c64 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:22.634753 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8d237902-700c-4a6a-826b-edcedb240c64 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1219 microversion: 2.1 time: 0.136196 Aug 31 09:57:22.635846 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 485/967] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:22 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:23.657097 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:23.657631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:23.664930 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:23.665587 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:23.666070 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:23.666752 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:23.667234 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:23.667655 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:23.746728 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:23.754610 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-c98823a9-0b19-440b-b4f1-5c08ba4b78ac tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1271 microversion: 2.1 time: 0.101425 Aug 31 09:57:23.755475 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 483/968] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:23 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:24.784206 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:24.784753 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:24.792945 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:24.793416 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:24.794050 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:24.794746 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:24.795233 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:24.795660 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:24.939055 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:24.948170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-da281a20-7e13-44a3-b2bf-f899ff249204 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1319 microversion: 2.1 time: 0.167834 Aug 31 09:57:24.962401 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 486/969] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:24 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:25.186061 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-7e9d7535-49c7-4841-a73f-cead2d792c9c req-e6aee039-d330-4394-8053-6ea1fc9cc96b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6876c27-0cb0-4fa5-b79e-2caef94936b0", "tag": "8bac08e1-327c-4a62-9e9d-ca65460f73cf"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:25.198212 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-7e9d7535-49c7-4841-a73f-cead2d792c9c req-e6aee039-d330-4394-8053-6ea1fc9cc96b service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:25.198906 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-7e9d7535-49c7-4841-a73f-cead2d792c9c req-e6aee039-d330-4394-8053-6ea1fc9cc96b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:25.199371 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-7e9d7535-49c7-4841-a73f-cead2d792c9c req-e6aee039-d330-4394-8053-6ea1fc9cc96b service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:25.213366 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-7e9d7535-49c7-4841-a73f-cead2d792c9c req-e6aee039-d330-4394-8053-6ea1fc9cc96b service nova] Creating event network-changed:8bac08e1-327c-4a62-9e9d-ca65460f73cf for instance e6876c27-0cb0-4fa5-b79e-2caef94936b0 on hv-cinder-83754 Aug 31 09:57:25.221660 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-7e9d7535-49c7-4841-a73f-cead2d792c9c req-e6aee039-d330-4394-8053-6ea1fc9cc96b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039482 Aug 31 09:57:25.222744 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 484/970] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:25.969770 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:25.970360 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:25.977883 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:25.980037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:25.980037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:25.980037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:25.980037 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:25.980435 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:26.118140 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:26.127253 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-26ef3fb7-ff51-47eb-a51a-512ff9348f8f tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1319 microversion: 2.1 time: 0.161400 Aug 31 09:57:26.127984 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 487/971] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:25 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:27.150639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:27.151412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:27.159898 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:27.161502 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:27.162897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:27.166691 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:27.167687 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:27.168915 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:27.445970 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:27.454726 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4e2a4d10-ef7d-43a7-b3bb-571205eb5609 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1319 microversion: 2.1 time: 0.309250 Aug 31 09:57:27.455340 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 485/972] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:27 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:28.480838 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:28.481751 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:28.488570 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:28.489062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:28.489719 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:28.490436 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:28.491716 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:28.492170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:28.703849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:28.715450 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-86f4d7a6-7c0a-4537-b890-173109f603ad tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1319 microversion: 2.1 time: 0.238027 Aug 31 09:57:28.717761 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 488/973] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:28 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:29.744214 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:29.746558 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:29.757725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:29.758721 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:29.759791 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:29.761159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:29.761860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:29.762452 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:29.985180 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:30.002544 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-caaf7098-e98a-4a9d-a885-2e071565e1cb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1319 microversion: 2.1 time: 0.267493 Aug 31 09:57:30.004379 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 486/974] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:29 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:31.034920 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:31.036976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:31.047942 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:31.048794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:31.050346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:31.051578 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:31.052247 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:31.053091 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:31.388811 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:31.403677 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-339f0a94-0e29-4a5b-94b6-ae784a2d956c tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1319 microversion: 2.1 time: 0.380872 Aug 31 09:57:31.407273 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 489/975] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:31 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:31.675734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-139d4af5-5a7d-4925-9a61-62bba1ad1125 req-7858a7f7-88ac-48ec-b9c6-3c9fc315018e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6876c27-0cb0-4fa5-b79e-2caef94936b0", "name": "network-vif-plugged", "status": "completed", "tag": "8bac08e1-327c-4a62-9e9d-ca65460f73cf"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:31.697905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-139d4af5-5a7d-4925-9a61-62bba1ad1125 req-7858a7f7-88ac-48ec-b9c6-3c9fc315018e service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:31.700332 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-139d4af5-5a7d-4925-9a61-62bba1ad1125 req-7858a7f7-88ac-48ec-b9c6-3c9fc315018e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:31.700821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-139d4af5-5a7d-4925-9a61-62bba1ad1125 req-7858a7f7-88ac-48ec-b9c6-3c9fc315018e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:31.733522 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-139d4af5-5a7d-4925-9a61-62bba1ad1125 req-7858a7f7-88ac-48ec-b9c6-3c9fc315018e service nova] Creating event network-vif-plugged:8bac08e1-327c-4a62-9e9d-ca65460f73cf for instance e6876c27-0cb0-4fa5-b79e-2caef94936b0 on hv-cinder-83754 Aug 31 09:57:31.738747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-139d4af5-5a7d-4925-9a61-62bba1ad1125 req-7858a7f7-88ac-48ec-b9c6-3c9fc315018e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067696 Aug 31 09:57:31.739543 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 487/976] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:57:32.430054 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:32.430448 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:32.441959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:32.447988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:32.448533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:32.449296 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:32.449908 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:32.450534 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:32.621009 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:32.629525 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-284ce825-b438-4ac9-859c-42ccf279ee43 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1319 microversion: 2.1 time: 0.204396 Aug 31 09:57:32.636315 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 490/977] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:32 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:33.652738 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:33.654186 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:33.656979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:33.658442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=6 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:33.668221 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:33.669004 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:33.669660 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:33.670337 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:33.670955 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:33.671558 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:33.899239 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:33.917871 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a88620e0-72c7-4319-bbfe-4f8dd77cd36a tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1319 microversion: 2.1 time: 0.269341 Aug 31 09:57:33.936485 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 488/978] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:33 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:57:34.961465 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:34.962287 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:34.964660 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:34.970743 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:34.971527 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:34.972470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:34.974760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:34.977063 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:34.977521 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:35.309885 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:57:35.322229 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8a501ae3-0192-4ddf-a1e0-81e2c1524b06 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1508 microversion: 2.1 time: 0.368073 Aug 31 09:57:35.323398 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 491/979] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:57:34 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:57:35.345162 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4b6916d2-6ac0-4866-a62f-5a288c16ecae tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47dd1e19-b55b-4e4c-af07-5c2218f34a02", "device": "/dev/sdb"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:35.349923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4b6916d2-6ac0-4866-a62f-5a288c16ecae tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:35.357643 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4b6916d2-6ac0-4866-a62f-5a288c16ecae tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:35.358506 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4b6916d2-6ac0-4866-a62f-5a288c16ecae tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:35.359178 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4b6916d2-6ac0-4866-a62f-5a288c16ecae tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:35.360173 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4b6916d2-6ac0-4866-a62f-5a288c16ecae tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:35.360841 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4b6916d2-6ac0-4866-a62f-5a288c16ecae tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:35.361457 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4b6916d2-6ac0-4866-a62f-5a288c16ecae tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:35.827362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4b6916d2-6ac0-4866-a62f-5a288c16ecae tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "POST /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485763 Aug 31 09:57:35.828182 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 489/980] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:57:35 2022] POST /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:57:39.415221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f1253b6a-f4a3-44d7-8ea0-d3755106e9db tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Action: 'create', calling method: .version_select at 0x7f9462ade430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1434420611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHAsQL+BlQqtjRxeXYmygmP51C2P9flYK9z2qP7VilzKRon+/CYM/94o61RqPxGLmoaNVVdFghnk4JBQGDarCe5Dw51BRQR4g9hcLQyWjVwhgSobjuLB0jnnN7RafS5JQ=="}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:57:39.437538 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-f1253b6a-f4a3-44d7-8ea0-d3755106e9db tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Getting quotas for project e73cfdbb50144b67a614836f73ed5b3d. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:57:39.442470 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-f1253b6a-f4a3-44d7-8ea0-d3755106e9db tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Getting quotas for user f4003700359449afb83a7352ff2b326a and project e73cfdbb50144b67a614836f73ed5b3d. Resources: {'key_pairs'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:57:39.471559 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f1253b6a-f4a3-44d7-8ea0-d3755106e9db tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.419512 Aug 31 09:57:39.472284 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 492/981] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:57:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:57:59.752356 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:57:59.752923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:57:59.755476 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:59.756271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:59.762824 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:59.763334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:59.763768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:59.764458 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:57:59.764905 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:57:59.765321 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:57:59.846720 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lazy-loading 'services' on Instance uuid e6876c27-0cb0-4fa5-b79e-2caef94936b0 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:57:59.920996 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9dd636bb-a795-4f90-9c72-4d11772564de tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0/os-volume_attachments/47dd1e19-b55b-4e4c-af07-5c2218f34a02" status: 202 len: 0 microversion: 2.1 time: 0.172748 Aug 31 09:57:59.921622 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 490/982] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 09:57:59 2022] DELETE /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0/os-volume_attachments/47dd1e19-b55b-4e4c-af07-5c2218f34a02 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:58:00.682492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=36 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:00.683283 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=4 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:00.683940 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:00.688082 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1480426203", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1434420611", "security_groups": [{"name": "tempest-secgroup-smoke-1050471927"}], "networks": [{"uuid": "849e3dae-27dd-4f28-abe9-70260e531524"}], "block_device_mapping_v2": [{"uuid": "bccb76fe-74f7-48e6-815d-eb6a6584f880", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:00.806566 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.network.neutron [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] validate_networks() for [('849e3dae-27dd-4f28-abe9-70260e531524', None, None, None, None, None)] {{(pid=132570) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:58:01.052112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:01.052703 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:01.059273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.059768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.060206 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.060912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.061367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.061792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.088056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Going to try to terminate instance {{(pid=132571) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:58:01.169169 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-01fdf39c-417c-48f6-a3fe-6b973775150d tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 204 len: 0 microversion: 2.1 time: 0.120882 Aug 31 09:58:01.169631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 491/983] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:01 2022] DELETE /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 09:58:01.179112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:01.179928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:01.186536 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.186726 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.187129 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.187851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.188309 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.188736 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.226217 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Flavor limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:58:01.227248 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Image limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:58:01.227821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Flavor pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:58:01.228328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Image pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:58:01.228652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:58:01.238734 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.239255 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.239709 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.240420 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:01.240872 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:01.241302 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:01.259907 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Getting quotas for project e73cfdbb50144b67a614836f73ed5b3d. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:58:01.264553 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Getting quotas for user f4003700359449afb83a7352ff2b326a and project e73cfdbb50144b67a614836f73ed5b3d. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:58:01.326990 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Going to run 1 instances... {{(pid=132570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:58:01.329181 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bccb76fe-74f7-48e6-815d-eb6a6584f880',volume_size=None,volume_type=None)] {{(pid=132570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:58:01.332562 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:01.341487 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3a05201e-bef0-4ace-aeb7-03c4ff76d3a6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1514 microversion: 2.1 time: 0.166767 Aug 31 09:58:01.342066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 492/984] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:01 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:01.469976 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6aa9cc0c-b866-4441-8492-9e93a1de2166 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788593 Aug 31 09:58:01.470794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 493/985] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:58:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:58:01.481776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b8a1975e-78cb-42e6-a6b2-6993440cba5e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:01.482386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b8a1975e-78cb-42e6-a6b2-6993440cba5e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:01.536360 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b8a1975e-78cb-42e6-a6b2-6993440cba5e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:01.544828 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b8a1975e-78cb-42e6-a6b2-6993440cba5e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1089 microversion: 2.1 time: 0.066723 Aug 31 09:58:01.545404 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 493/986] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:01 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:02.364787 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:02.365401 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:02.373267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:02.373759 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:02.374231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:02.374892 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:02.375383 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:02.375813 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:02.506021 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:02.514534 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-61822aa2-9756-4fe0-bc65-fa47db79cbc5 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1514 microversion: 2.1 time: 0.154145 Aug 31 09:58:02.515111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 494/987] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:02 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:02.566158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:02.566779 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:02.574273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:02.574750 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:02.575226 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:02.576006 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:02.576557 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:02.577002 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:02.644198 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:02.652012 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d293a719-4d95-4a09-8340-64432d0f354e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1139 microversion: 2.1 time: 0.089706 Aug 31 09:58:02.652630 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 494/988] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:02 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:03.536432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:03.536432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:03.544054 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:03.544792 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:03.545642 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:03.546411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:03.546795 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:03.547243 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:03.673031 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:03.674429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:03.681849 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:03.682254 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:03.682809 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:03.683777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:03.684990 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:03.685429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:03.689396 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:03.698936 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-adcf490f-f2eb-4f6d-b5a5-d2da074d17c1 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1514 microversion: 2.1 time: 0.167264 Aug 31 09:58:03.699564 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 495/989] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:03 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:03.760568 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:03.768249 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-018a050b-fd7d-444b-bd98-c6d9915c0a17 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1187 microversion: 2.1 time: 0.099039 Aug 31 09:58:03.768822 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 495/990] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:03 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:03.953191 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-a4eef190-f9c0-44c3-896b-cdd678c5b070 req-2c437705-fd01-4c06-ad6e-65cd84eca0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6876c27-0cb0-4fa5-b79e-2caef94936b0", "name": "network-vif-deleted", "tag": "8bac08e1-327c-4a62-9e9d-ca65460f73cf"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:03.963758 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-a4eef190-f9c0-44c3-896b-cdd678c5b070 req-2c437705-fd01-4c06-ad6e-65cd84eca0c3 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:03.964238 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-a4eef190-f9c0-44c3-896b-cdd678c5b070 req-2c437705-fd01-4c06-ad6e-65cd84eca0c3 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:03.964670 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-a4eef190-f9c0-44c3-896b-cdd678c5b070 req-2c437705-fd01-4c06-ad6e-65cd84eca0c3 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:03.976843 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-a4eef190-f9c0-44c3-896b-cdd678c5b070 req-2c437705-fd01-4c06-ad6e-65cd84eca0c3 service nova] Creating event network-vif-deleted:8bac08e1-327c-4a62-9e9d-ca65460f73cf for instance e6876c27-0cb0-4fa5-b79e-2caef94936b0 on hv-cinder-83754 Aug 31 09:58:03.982688 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-a4eef190-f9c0-44c3-896b-cdd678c5b070 req-2c437705-fd01-4c06-ad6e-65cd84eca0c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033028 Aug 31 09:58:03.983346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 496/991] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:04.720872 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:04.721424 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:04.729779 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:04.730323 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:04.730813 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:04.731547 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:04.731995 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:04.732467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:04.766875 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:04.767732 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:04.768246 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:04.768872 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lazy-loading 'fault' on Instance uuid e6876c27-0cb0-4fa5-b79e-2caef94936b0 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:58:04.793026 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:04.793801 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:04.800602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:04.801174 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:04.801725 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:04.802763 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:04.803450 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:04.803871 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:04.834535 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '488e41d766134f3aa7c956816d01df06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbdd47c941404548bf5371c35e518346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:04.845289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-beea7d3f-9a6e-4ec8-ab71-eab85ae70bbb tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 200 len: 1309 microversion: 2.1 time: 0.128626 Aug 31 09:58:04.861956 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 496/992] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:04 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 1309 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:04.988946 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:04.997598 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9eff367e-43bd-468b-8548-94baecc6983a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1273 microversion: 2.1 time: 0.210684 Aug 31 09:58:04.998187 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 497/993] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:04 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:05.868837 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:05.869442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] [instance: e6876c27-0cb0-4fa5-b79e-2caef94936b0] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:05.876527 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:05.877030 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:05.877466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:05.878206 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:05.878695 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:05.879141 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:05.895141 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] HTTP exception thrown: Instance e6876c27-0cb0-4fa5-b79e-2caef94936b0 could not be found. Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Request method failure captured: Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 HTTP/1.1 Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDzAodDVEJOhof8lE3o1GTCsxfL6scELBmcapKfQAgJoggwVs90EeWoqDO5rUobiic5pyRhyIjWOaZ4K115022h6X2RK9ycjOPyQaR4IyNZ_ho3EzvJK8K90G3gTSG3dYzQKFni8aRj5lyeWq1tvLHxODa4eCnFyIrsl1Qqs0NflTAQ0 Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: fbdd47c941404548bf5371c35e518346 Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-VolumesSnapshotTestJSON-390608872 Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:58:05.896827 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fbdd47c941404548bf5371c35e518346"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fbdd47c941404548bf5371c35e518346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fbdd47c941404548bf5371c35e518346"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fbdd47c941404548bf5371c35e518346"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-VolumesSnapshotTestJSON-390608872 Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: fbdd47c941404548bf5371c35e518346 Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-390608872 Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-VolumesSnapshotTestJSON-390608872-project Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 488e41d766134f3aa7c956816d01df06 Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-VolumesSnapshotTestJSON-390608872-project Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance e6876c27-0cb0-4fa5-b79e-2caef94936b0 could not be found. Aug 31 09:58:05.899889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'e6876c27-0cb0-4fa5-b79e-2caef94936b0'} Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6876c27-0cb0-4fa5-b79e-2caef94936b0 could not be found. Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:58:05.900747 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6876c27-0cb0-4fa5-b79e-2caef94936b0 could not be found. Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6876c27-0cb0-4fa5-b79e-2caef94936b0 could not be found. Aug 31 09:58:05.902105 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:58:05.903403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] Returning 404 to user: Instance e6876c27-0cb0-4fa5-b79e-2caef94936b0 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:58:05.903403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8380d1c5-377a-427a-8b57-ce9a0d6539d6 tempest-VolumesSnapshotTestJSON-390608872 tempest-VolumesSnapshotTestJSON-390608872-project] 10.222.0.36 "GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0" status: 404 len: 111 microversion: 2.1 time: 0.034321 Aug 31 09:58:05.903403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 497/994] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:05 2022] GET /compute/v2.1/servers/e6876c27-0cb0-4fa5-b79e-2caef94936b0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:06.018382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:06.019638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:06.026863 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:06.027637 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:06.028118 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:06.028826 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:06.029489 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:06.029928 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:06.035558 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-1f508edd-070d-46fe-ab14-1fc387299630 req-ee5eb1de-21d1-489f-bca1-68ee360ec400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4", "tag": "b7e2db10-953b-43a4-928b-97b8843ac6a8"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:06.048056 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-1f508edd-070d-46fe-ab14-1fc387299630 req-ee5eb1de-21d1-489f-bca1-68ee360ec400 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:06.048283 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-1f508edd-070d-46fe-ab14-1fc387299630 req-ee5eb1de-21d1-489f-bca1-68ee360ec400 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:06.048777 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-1f508edd-070d-46fe-ab14-1fc387299630 req-ee5eb1de-21d1-489f-bca1-68ee360ec400 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:06.062697 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-1f508edd-070d-46fe-ab14-1fc387299630 req-ee5eb1de-21d1-489f-bca1-68ee360ec400 service nova] Creating event network-changed:b7e2db10-953b-43a4-928b-97b8843ac6a8 for instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 on hv-cinder-83754 Aug 31 09:58:06.068615 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-1f508edd-070d-46fe-ab14-1fc387299630 req-ee5eb1de-21d1-489f-bca1-68ee360ec400 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036731 Aug 31 09:58:06.071293 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 498/995] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:58:06.225482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:06.238591 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-125aaaf1-a5f2-4e37-86ed-65df9ec379ea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.224149 Aug 31 09:58:06.239518 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 498/996] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:06 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:07.261161 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:07.261867 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:07.269984 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:07.270481 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:07.270912 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:07.271746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:07.272206 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:07.272633 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:07.417477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:07.434404 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-34390f57-b6de-4eaf-849c-2116e286eebd tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.172281 Aug 31 09:58:07.436239 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 499/997] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:07 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:08.457078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:08.457690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:08.464303 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:08.464786 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:08.465213 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:08.465916 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:08.466368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:08.466788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:08.599882 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:08.607678 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ccf0eb83-6c36-40be-9d83-be222712f52a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.154476 Aug 31 09:58:08.608249 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 499/998] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:08 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:09.629411 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:09.630140 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:09.636778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:09.637263 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:09.637698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:09.638398 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:09.638848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:09.639320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:09.784958 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:09.795210 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-48b70086-7143-4174-8998-44e831f6d1a6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.169451 Aug 31 09:58:09.795795 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 500/999] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:09 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:10.816662 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:10.817203 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:10.825216 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:10.825701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:10.826134 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:10.826835 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:10.827321 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:10.827744 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:10.966551 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:10.975011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-87186da0-720f-4144-ae52-f9c78d8e14da tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.162287 Aug 31 09:58:10.975661 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 500/1000] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:10 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:11.996823 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:11.997545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:12.000097 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:12.005462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:12.005949 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:12.006386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:12.007084 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:12.008107 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:12.008542 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:12.155689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:12.164642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a3bc0580-a37c-4210-8546-91bd636f198c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.171997 Aug 31 09:58:12.165241 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 501/1001] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:11 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:13.190370 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:13.190900 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:13.192891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:13.193689 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=6 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:13.199715 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:13.200200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:13.200634 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:13.201328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:13.201823 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:13.202205 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:13.344902 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:13.353304 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8daa7032-0fce-41a0-a544-9f15532b7bcc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.166778 Aug 31 09:58:13.353880 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 501/1002] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:13 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:14.375351 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:14.375831 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:14.383079 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:14.383756 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:14.384195 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:14.384955 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:14.385416 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:14.385878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:14.537490 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:14.548776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-96476d69-7687-4c27-9c94-4811419d99d6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.178357 Aug 31 09:58:14.549360 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 502/1003] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:14 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:15.570390 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:15.572089 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:15.578441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:15.579000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:15.579533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:15.580441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:15.580947 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:15.581430 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:15.759577 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:15.775604 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-33f90948-cb93-4b94-841f-c0d4cc1ff641 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.209438 Aug 31 09:58:15.776411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 502/1004] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:15 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:58:16.797342 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:16.797956 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:16.804785 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:16.805269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:16.805705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:16.806399 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:16.806856 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:16.807325 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:16.939316 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:16.947047 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e4a2d310-8960-4896-b2e9-ff6fe581a7bc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.153606 Aug 31 09:58:16.947638 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 503/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:16 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:17.967701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:17.968441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:17.974974 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:17.975512 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:17.976495 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:17.977209 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:17.977658 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:17.978079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:18.129386 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:18.137727 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4485fc29-c739-4ad8-a936-9b45adb722f6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.173843 Aug 31 09:58:18.138311 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 503/1006] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:17 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:19.158283 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:19.158895 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:19.166444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:19.166928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:19.167394 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:19.168123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:19.168576 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:19.168998 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:19.302428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:19.310274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-aa53f5c1-edaf-48cf-bfa4-06d18dfc4ff8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.155878 Aug 31 09:58:19.310848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 504/1007] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:19 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:19.555767 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-708985df-6984-456c-b0a2-7a199e15f990 req-bc84aaa7-e840-4da2-9712-bd81068c3416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4", "name": "network-vif-plugged", "status": "completed", "tag": "b7e2db10-953b-43a4-928b-97b8843ac6a8"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:19.565862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-708985df-6984-456c-b0a2-7a199e15f990 req-bc84aaa7-e840-4da2-9712-bd81068c3416 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:19.566346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-708985df-6984-456c-b0a2-7a199e15f990 req-bc84aaa7-e840-4da2-9712-bd81068c3416 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:19.566944 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-708985df-6984-456c-b0a2-7a199e15f990 req-bc84aaa7-e840-4da2-9712-bd81068c3416 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:19.580960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-708985df-6984-456c-b0a2-7a199e15f990 req-bc84aaa7-e840-4da2-9712-bd81068c3416 service nova] Creating event network-vif-plugged:b7e2db10-953b-43a4-928b-97b8843ac6a8 for instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 on hv-cinder-83754 Aug 31 09:58:19.586873 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-708985df-6984-456c-b0a2-7a199e15f990 req-bc84aaa7-e840-4da2-9712-bd81068c3416 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035972 Aug 31 09:58:19.587553 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 504/1008] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:20.331454 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:20.332054 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:20.338984 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.339503 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.339933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.340624 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:20.341080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:20.341502 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:20.475989 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:20.483699 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2e51b6bc-e1f9-4772-92c1-c7a02c3b3433 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1261 microversion: 2.1 time: 0.156058 Aug 31 09:58:20.484266 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 505/1009] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:20 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:21.506078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:21.506761 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:21.513603 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.514077 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.514503 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.515204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.515652 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.516082 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.653199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:21.663032 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f7788dbe-44c3-4865-bf50-6f57d037511c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1445 microversion: 2.1 time: 0.161484 Aug 31 09:58:21.664549 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 505/1010] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:21 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1445 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:21.685411 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:21.686209 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:21.692765 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.693250 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.693689 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.694402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:21.694955 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:21.695416 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:21.699552 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:21.845614 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:21.855112 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-77abc7f5-1e1c-45b6-a426-018e2a718a3a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1445 microversion: 2.1 time: 0.173642 Aug 31 09:58:21.855642 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 506/1011] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:21 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:58:23.847957 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-01372d2a-0459-42b2-82eb-490c6376e303 req-00de1945-5158-4286-87e3-9d474ebf257a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4", "tag": "b7e2db10-953b-43a4-928b-97b8843ac6a8"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:23.864682 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-01372d2a-0459-42b2-82eb-490c6376e303 req-00de1945-5158-4286-87e3-9d474ebf257a service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:23.865166 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-01372d2a-0459-42b2-82eb-490c6376e303 req-00de1945-5158-4286-87e3-9d474ebf257a service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:23.865599 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-01372d2a-0459-42b2-82eb-490c6376e303 req-00de1945-5158-4286-87e3-9d474ebf257a service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:23.881295 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-01372d2a-0459-42b2-82eb-490c6376e303 req-00de1945-5158-4286-87e3-9d474ebf257a service nova] Creating event network-changed:b7e2db10-953b-43a4-928b-97b8843ac6a8 for instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 on hv-cinder-83754 Aug 31 09:58:23.886550 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-01372d2a-0459-42b2-82eb-490c6376e303 req-00de1945-5158-4286-87e3-9d474ebf257a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044589 Aug 31 09:58:23.887185 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 506/1012] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:54.337914 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8e891374-6801-4ca5-b21f-70c2511e56b9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Action: 'create', calling method: .version_select at 0x7f9462998f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1223368833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbLg12cMw/hrcuXcU5WYhWpqqIrFQ1RQD+nZ1UWB+Ut8GYatboi/ewvLU3wADCMd9bZnPatkA3eO6v2135w03eipY+yW6tAgnxK1VdxMqc3BAe5QfOAytIs1wIUvkN4yQ=="}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:54.344233 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:54.344951 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=4 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:54.360636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-8e891374-6801-4ca5-b21f-70c2511e56b9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Getting quotas for project 3ad415e35f8746ff86bd0d4f96c3ca9e. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:58:54.364889 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.quota [None req-8e891374-6801-4ca5-b21f-70c2511e56b9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Getting quotas for user f6393be1efdd4c12bcf3adbb230c4943 and project 3ad415e35f8746ff86bd0d4f96c3ca9e. Resources: {'key_pairs'} {{(pid=132571) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:58:54.399494 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8e891374-6801-4ca5-b21f-70c2511e56b9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.066304 Aug 31 09:58:54.400395 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 507/1013] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Aug 31 09:58:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:58:54.454002 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:54.454888 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=68 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:54.460602 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-582993788", "imageRef": "7df7f22f-eb99-42ab-b8a6-0480f4982602", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1223368833", "networks": [{"uuid": "9262e692-9486-4539-a3bf-95b18b26a2a8"}]}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:54.716058 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.network.neutron [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] validate_networks() for [('9262e692-9486-4539-a3bf-95b18b26a2a8', None, None, None, None, None)] {{(pid=132570) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 09:58:55.173804 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Flavor limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 09:58:55.174371 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Image limits 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 09:58:55.174850 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Flavor pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 09:58:55.175340 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Image pref 0:0:0 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 09:58:55.175789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.virt.hardware [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132570) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 09:58:55.188738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:55.188738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:55.188738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:55.188738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:55.189274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:55.189274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:55.207146 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Getting quotas for project 3ad415e35f8746ff86bd0d4f96c3ca9e. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 09:58:55.212537 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.quota [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Getting quotas for user f6393be1efdd4c12bcf3adbb230c4943 and project 3ad415e35f8746ff86bd0d4f96c3ca9e. Resources: {'cores', 'ram', 'instances'} {{(pid=132570) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 09:58:55.223878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Going to run 1 instances... {{(pid=132570) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 09:58:55.226795 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7df7f22f-eb99-42ab-b8a6-0480f4982602',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132570) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 09:58:55.277917 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-5c646a2d-8577-4c98-a12b-6e45c3d1767c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825524 Aug 31 09:58:55.278580 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 507/1014] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Aug 31 09:58:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 09:58:55.290334 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8ddea5a0-ec04-4912-84c3-f413d61cda77 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:55.291284 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8ddea5a0-ec04-4912-84c3-f413d61cda77 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:55.527230 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8ddea5a0-ec04-4912-84c3-f413d61cda77 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:55.536597 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8ddea5a0-ec04-4912-84c3-f413d61cda77 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1258 microversion: 2.1 time: 0.250934 Aug 31 09:58:55.537800 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 508/1015] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:55 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:58:56.560666 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:56.561441 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:56.569411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:56.569940 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:56.570374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:56.571386 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:56.571849 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:56.572431 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:56.648437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:56.657643 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0aa287b5-f722-4f53-a135-2cdbcc8cb9cc tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1310 microversion: 2.1 time: 0.102369 Aug 31 09:58:56.658249 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 508/1016] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:56 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:57.544500 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:57.545082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:57.561088 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:57.561593 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:57.562042 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:57.562766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:57.563279 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:57.563693 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:57.593792 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-2c405d35-ce21-485c-bc50-41ec8b101a85 req-aa7f0f24-5d0a-490a-a45f-0814fcefd0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c0db77-8866-4dd0-9546-cdb48ce54f5b", "tag": "68354a65-9e07-4517-8ae7-88995bfb7479"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:58:57.621013 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-2c405d35-ce21-485c-bc50-41ec8b101a85 req-aa7f0f24-5d0a-490a-a45f-0814fcefd0d9 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:57.622164 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-2c405d35-ce21-485c-bc50-41ec8b101a85 req-aa7f0f24-5d0a-490a-a45f-0814fcefd0d9 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:57.622610 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-2c405d35-ce21-485c-bc50-41ec8b101a85 req-aa7f0f24-5d0a-490a-a45f-0814fcefd0d9 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:57.643830 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Going to try to terminate instance {{(pid=132571) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:58:57.648955 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-2c405d35-ce21-485c-bc50-41ec8b101a85 req-aa7f0f24-5d0a-490a-a45f-0814fcefd0d9 service nova] Creating event network-changed:68354a65-9e07-4517-8ae7-88995bfb7479 for instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b on hv-cinder-83754 Aug 31 09:58:57.656832 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-2c405d35-ce21-485c-bc50-41ec8b101a85 req-aa7f0f24-5d0a-490a-a45f-0814fcefd0d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067245 Aug 31 09:58:57.657738 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 509/1017] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:58:57.681261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:57.681389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:57.693901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:57.694369 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:57.694807 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:57.695556 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:57.696014 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:57.696438 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:57.802487 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a783674b-714b-4d51-abca-c7d2ae15836f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 204 len: 0 microversion: 2.1 time: 0.259933 Aug 31 09:58:57.810553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 509/1018] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:58:57 2022] DELETE /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:58:57.833205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:57.835836 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:57.855848 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:57.858408 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:57.859728 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:57.862742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:57.866972 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:57.868571 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:57.900207 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:57.907977 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7dd7f672-f4cb-47dd-8989-263962b9d125 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1316 microversion: 2.1 time: 0.232502 Aug 31 09:58:57.915898 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 510/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:57 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:58:58.308066 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:58.316685 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2f61015b-121f-43c9-b43e-58b6d2330140 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.502757 Aug 31 09:58:58.317443 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 510/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:57 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:58.940269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:58.940883 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:58.948385 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:58.948871 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:58.949310 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:58.950003 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:58.950458 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:58.950883 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:59.088648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:59.096389 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e364e05a-dbdc-4ef6-9002-594d63e5f6bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.159979 Aug 31 09:58:59.096948 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 511/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:58 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:58:59.339537 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:58:59.340158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:58:59.347005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:59.347541 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:59.347978 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:59.348682 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:58:59.349137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:58:59.349566 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:58:59.496634 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:58:59.504809 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3857d444-d0aa-479c-a31a-2b9adf650aad tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.169609 Aug 31 09:58:59.505403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 511/1022] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:58:59 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:00.119221 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:00.119833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:00.126590 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:00.127747 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:00.128382 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:00.129269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:00.129724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:00.130176 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:00.275356 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:00.283246 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-410def15-b645-415e-beba-51ae7c5cd399 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.169278 Aug 31 09:59:00.284062 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 512/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:00 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:00.528319 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:00.528993 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:00.536362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:00.537453 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:00.538569 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:00.539308 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:00.539768 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:00.540193 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:00.690062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:00.698711 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5b612f17-dc9e-49f3-853b-5768dc131fd0 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.174442 Aug 31 09:59:00.699328 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 512/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:00 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:01.304862 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:01.305480 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:01.312436 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:01.312928 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:01.313364 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:01.314341 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:01.314969 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:01.315421 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:01.460799 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:01.468961 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1cd8af74-6eb3-400c-b801-b723b3f89dd1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.167952 Aug 31 09:59:01.483258 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 513/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:01 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:01.720592 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:01.721231 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:01.732785 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:01.733275 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:01.733706 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:01.734403 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:01.734851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:01.735302 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:01.893791 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:01.902117 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-97fb4ea3-846c-4074-9f62-07aeb980a807 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.185509 Aug 31 09:59:01.902880 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 513/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:01 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:02.490673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:02.491724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:02.498163 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:02.498651 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:02.499079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:02.499901 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:02.500352 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:02.500769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:02.643725 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:02.652348 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3395d9d2-ef4a-4f6b-ab21-b5f7fbef68dd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.165458 Aug 31 09:59:02.652927 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 514/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:02 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:02.923743 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:02.924376 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:02.932170 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:02.932695 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:02.933134 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:02.933845 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:02.934328 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:02.934776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:03.088961 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:03.101937 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a74223ce-6bbe-4776-a549-12fb36b902f4 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.181670 Aug 31 09:59:03.103859 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 514/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:02 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:03.674231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:03.674935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:03.682246 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:03.682742 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:03.683749 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:03.683935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:03.684363 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:03.684793 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:03.834724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:03.851213 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-e9fc4d12-c1dc-4239-8001-04a2c515a268 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.180727 Aug 31 09:59:03.866998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 515/1029] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:03 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:04.129611 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:04.130220 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:04.137315 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:04.137802 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:04.138249 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:04.138962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:04.139455 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:04.139881 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:04.292559 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:04.303754 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-7cda9600-6c89-4bcd-879b-b0202bac9850 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.177614 Aug 31 09:59:04.304372 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 515/1030] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:04 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:04.873953 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:04.874573 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:04.881572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:04.882084 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:04.882576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:04.883291 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:04.883748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:04.884277 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:05.027030 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:05.035039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fc33fbc7-a909-4013-a93a-d9e34b4d82d5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.164928 Aug 31 09:59:05.035638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 516/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:04 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:05.325820 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:05.326716 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:05.334443 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:05.334931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:05.335385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:05.336676 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:05.336676 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:05.336957 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:05.521568 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:05.530386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bd9d8d89-d5f1-4088-a39b-436267556de3 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.208523 Aug 31 09:59:05.530983 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 516/1032] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:05 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:06.065858 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:06.066511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:06.070939 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=2 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:06.076982 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell0:SELECT=6 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:06.083663 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:06.084827 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:06.085288 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:06.086010 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:06.086465 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:06.086891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:06.247552 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:06.255915 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2db58604-bafd-437c-8f08-d8838fab0461 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.203475 Aug 31 09:59:06.256609 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 517/1033] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:06 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:06.566667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:06.568246 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:06.574328 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=6 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:06.576608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:06.577170 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:06.577756 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:06.578347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:06.579790 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:06.579790 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:06.754823 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:06.765855 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-5bbcb10b-25ea-469f-b906-c72ae3b3bc79 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.202912 Aug 31 09:59:06.766525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 517/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:06 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:07.278619 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:07.279431 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:07.285810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:07.286289 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:07.287310 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:07.288007 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:07.288453 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:07.288870 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:07.437499 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:07.449189 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-43681e5d-4afe-4f74-aa7f-3c08504ac8c4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.174475 Aug 31 09:59:07.449820 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 518/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:07 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:07.789665 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:07.790470 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:07.796985 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:07.797462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:07.797896 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:07.798595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:07.799048 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:07.799494 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:07.937462 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:07.945708 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e83b9841-ca8a-41ac-a419-c61d8339538e tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.160431 Aug 31 09:59:07.946291 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 518/1036] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:07 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:08.469875 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:08.470492 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:08.478792 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:08.479446 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:08.479939 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:08.480741 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:08.481189 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:08.481637 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:08.620622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:08.628585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3d7f5f08-850f-4a5d-9c26-9f550beac0d3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.162559 Aug 31 09:59:08.629191 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 519/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:08 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:08.967609 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:08.968322 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:08.975737 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:08.976254 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:08.976677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:08.977400 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:08.977860 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:08.978289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:09.317828 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:09.327417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a4054ac7-aedb-44f8-b742-07de013e2d92 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1575 microversion: 2.1 time: 0.363645 Aug 31 09:59:09.328171 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 519/1038] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:08 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1575 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:09.655039 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:09.656415 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:09.664745 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:09.665396 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:09.666114 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:09.667074 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:09.667653 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:09.668126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:09.876404 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-91928383-fa50-43cf-917a-3904b5552713 req-78d3d998-c69b-4872-a418-d972cef910e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e4458d-e6f9-4340-9b31-4e2e67eb8acb", "tag": "389cd736-ae81-48e5-b1bb-5b148dd4f035"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:09.886886 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-91928383-fa50-43cf-917a-3904b5552713 req-78d3d998-c69b-4872-a418-d972cef910e4 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:09.887734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-91928383-fa50-43cf-917a-3904b5552713 req-78d3d998-c69b-4872-a418-d972cef910e4 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:09.888188 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-91928383-fa50-43cf-917a-3904b5552713 req-78d3d998-c69b-4872-a418-d972cef910e4 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:09.900348 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-91928383-fa50-43cf-917a-3904b5552713 req-78d3d998-c69b-4872-a418-d972cef910e4 service nova] Creating event network-changed:389cd736-ae81-48e5-b1bb-5b148dd4f035 for instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb on hv-cinder-83754 Aug 31 09:59:09.905514 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-91928383-fa50-43cf-917a-3904b5552713 req-78d3d998-c69b-4872-a418-d972cef910e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137088 Aug 31 09:59:09.906595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 520/1039] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:59:09.912679 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-47b93723-7984-45d4-a217-9f174328e529 req-114c5fef-7d5f-4004-a8cf-69259b99ed39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c0db77-8866-4dd0-9546-cdb48ce54f5b", "name": "network-vif-deleted", "tag": "68354a65-9e07-4517-8ae7-88995bfb7479"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:09.922620 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-47b93723-7984-45d4-a217-9f174328e529 req-114c5fef-7d5f-4004-a8cf-69259b99ed39 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:09.923746 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-47b93723-7984-45d4-a217-9f174328e529 req-114c5fef-7d5f-4004-a8cf-69259b99ed39 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:09.924281 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-47b93723-7984-45d4-a217-9f174328e529 req-114c5fef-7d5f-4004-a8cf-69259b99ed39 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:09.938155 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-47b93723-7984-45d4-a217-9f174328e529 req-114c5fef-7d5f-4004-a8cf-69259b99ed39 service nova] Creating event network-vif-deleted:68354a65-9e07-4517-8ae7-88995bfb7479 for instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b on hv-cinder-83754 Aug 31 09:59:09.943091 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-47b93723-7984-45d4-a217-9f174328e529 req-114c5fef-7d5f-4004-a8cf-69259b99ed39 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034950 Aug 31 09:59:09.943917 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 521/1040] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:09.947437 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:09.955374 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-8f4a0954-6fbd-4126-ab0c-66b9090e9890 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.304293 Aug 31 09:59:09.956222 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 520/1041] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:09 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:10.352369 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:10.354072 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:10.362097 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:10.362946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:10.363459 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:10.364818 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:10.365499 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:10.366129 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:10.406270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:10.406594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:10.406988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:10.408062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lazy-loading 'fault' on Instance uuid d5c0db77-8866-4dd0-9546-cdb48ce54f5b {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:59:10.455430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:10.469216 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-311704e9-a380-4abe-840a-6c3dffc338ff tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1229 microversion: 2.1 time: 0.121319 Aug 31 09:59:10.470321 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 522/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:10 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1229 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:10.984268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:10.984880 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:10.991773 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:10.992259 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:10.992702 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:10.993411 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:10.993869 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:10.994290 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.138261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:11.146053 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-89440171-caf5-4aa1-8650-a18146af71bb tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.165636 Aug 31 09:59:11.146678 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 521/1043] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:10 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:11.496505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:11.497100 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:11.503875 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:11.504362 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:11.504798 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.505503 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:11.506522 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:11.506945 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.545952 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:11.546446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:11.546935 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:11.547415 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lazy-loading 'fault' on Instance uuid d5c0db77-8866-4dd0-9546-cdb48ce54f5b {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 09:59:11.602282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:11.610509 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1a2ce20e-6b67-4faf-a196-34682ba240bc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 200 len: 1229 microversion: 2.1 time: 0.117927 Aug 31 09:59:11.611099 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 523/1044] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:11 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 1229 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:12.167299 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:12.168005 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:12.174075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:12.174559 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:12.174991 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:12.175720 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:12.176167 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:12.176593 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:12.339733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:12.347695 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-75322cf3-a350-4fb5-9a1d-f1526dddf9b1 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.185665 Aug 31 09:59:12.348284 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 522/1045] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:12 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:12.632118 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:12.632776 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: d5c0db77-8866-4dd0-9546-cdb48ce54f5b] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:12.638926 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:12.639448 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:12.639890 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:12.640594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:12.641051 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:12.641477 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:12.655172 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] HTTP exception thrown: Instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b could not be found. Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Request method failure captured: Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b HTTP/1.1 Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy8Ir8ZylJRAXm4qtYFtPlnT4xr6o9k9azhjHgJN4LC__98UntzAqsCKzy7uxpctYSz7duNSOt1295SVz_YIGr2X09ZKXe0oGZnzjFmXpbSAN5I-4N4fq7Viwt2kvYQ3WvttHC4FOgpG0fM7KFKCz0l1ki4NJBVyFJ2wAcIOqMFuHbU Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:59:12.656897 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 893e06c5ea99497fae2847399b7a1a3c Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b could not be found. Aug 31 09:59:12.659093 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': 'd5c0db77-8866-4dd0-9546-cdb48ce54f5b'} Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b could not be found. Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:12.660847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b could not be found. Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b could not be found. Aug 31 09:59:12.664367 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:12.666718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Returning 404 to user: Instance d5c0db77-8866-4dd0-9546-cdb48ce54f5b could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:12.666718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d44c1d4c-565c-460b-973c-c391bf985740 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b" status: 404 len: 111 microversion: 2.1 time: 0.030244 Aug 31 09:59:12.666718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 524/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:12 2022] GET /compute/v2.1/servers/d5c0db77-8866-4dd0-9546-cdb48ce54f5b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:13.372107 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:13.372671 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:13.378973 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:13.379476 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:13.379906 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:13.381098 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:13.381543 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:13.382113 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:13.513193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:13.520750 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2bd11f39-fde8-4c16-9bd5-5388a191e0e5 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.152680 Aug 31 09:59:13.522387 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 523/1047] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:13 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:14.541973 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:14.542586 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:14.549862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:14.550347 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:14.550781 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:14.551501 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:14.551979 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:14.552428 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:14.556640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:14.689028 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:14.696843 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-facabe12-024c-426f-a3fe-2ee492992499 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.158880 Aug 31 09:59:14.697471 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 525/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:14 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:15.717982 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:15.718914 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:15.727115 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:15.727744 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:15.728252 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:15.729041 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:15.729562 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:15.730147 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:15.758146 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-ea760cef-7939-4da5-bdcc-a3acdf1d99a4 req-6ff3e8f4-1903-4d6e-8515-17623c88d995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e4458d-e6f9-4340-9b31-4e2e67eb8acb", "name": "network-vif-plugged", "status": "completed", "tag": "389cd736-ae81-48e5-b1bb-5b148dd4f035"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:15.771270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-ea760cef-7939-4da5-bdcc-a3acdf1d99a4 req-6ff3e8f4-1903-4d6e-8515-17623c88d995 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:15.772306 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-ea760cef-7939-4da5-bdcc-a3acdf1d99a4 req-6ff3e8f4-1903-4d6e-8515-17623c88d995 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:15.773137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-ea760cef-7939-4da5-bdcc-a3acdf1d99a4 req-6ff3e8f4-1903-4d6e-8515-17623c88d995 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:15.786191 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-ea760cef-7939-4da5-bdcc-a3acdf1d99a4 req-6ff3e8f4-1903-4d6e-8515-17623c88d995 service nova] Creating event network-vif-plugged:389cd736-ae81-48e5-b1bb-5b148dd4f035 for instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb on hv-cinder-83754 Aug 31 09:59:15.792608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-ea760cef-7939-4da5-bdcc-a3acdf1d99a4 req-6ff3e8f4-1903-4d6e-8515-17623c88d995 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041271 Aug 31 09:59:15.793878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 526/1049] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:59:15.966231 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:15.970839 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=100 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:15.980640 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-f9c3b2a9-67d8-425f-8eb1-762404d05968 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.266391 Aug 31 09:59:15.981553 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 524/1050] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:15 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:16.210344 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-cb03f87b-2d34-4c00-bdb7-2df3dcf030c6 req-f9f25985-14f7-4b28-84e8-64c74d963f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67ac26dc-0a69-4f0d-9d00-5f35ddc03871", "tag": "4bc08194-a758-4e1a-9082-fc97cf1c95fb"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:16.218616 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:16.219159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:16.226613 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.227421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.227968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.228716 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-cb03f87b-2d34-4c00-bdb7-2df3dcf030c6 req-f9f25985-14f7-4b28-84e8-64c74d963f27 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.228840 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.229199 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-cb03f87b-2d34-4c00-bdb7-2df3dcf030c6 req-f9f25985-14f7-4b28-84e8-64c74d963f27 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.229444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.229939 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.230051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-cb03f87b-2d34-4c00-bdb7-2df3dcf030c6 req-f9f25985-14f7-4b28-84e8-64c74d963f27 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.242816 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-cb03f87b-2d34-4c00-bdb7-2df3dcf030c6 req-f9f25985-14f7-4b28-84e8-64c74d963f27 service nova] Creating event network-changed:4bc08194-a758-4e1a-9082-fc97cf1c95fb for instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 on hv-cinder-83754 Aug 31 09:59:16.248330 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-cb03f87b-2d34-4c00-bdb7-2df3dcf030c6 req-f9f25985-14f7-4b28-84e8-64c74d963f27 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042079 Aug 31 09:59:16.248935 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 525/1051] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:16.259060 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Going to try to terminate instance {{(pid=132571) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 09:59:16.344971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1f92f4f8-ed27-44e4-8ac4-a842790cbb30 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "DELETE /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 204 len: 0 microversion: 2.1 time: 0.140872 Aug 31 09:59:16.345558 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 527/1052] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:59:16 2022] DELETE /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 09:59:16.354776 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:16.355499 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:16.362018 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.362501 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.362926 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.363645 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:16.364095 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:16.364511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:16.511745 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:16.520881 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-90b8310b-c24f-46ed-892f-36360e71d9f7 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1577 microversion: 2.1 time: 0.170651 Aug 31 09:59:16.521488 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 526/1053] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:16 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:17.005573 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:17.006915 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:17.014402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.015225 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.015691 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.016792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.017430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.018123 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.173893 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:17.194291 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fc4d2ab9-8ca4-4895-ae92-ff84c8424498 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.192832 Aug 31 09:59:17.194971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 528/1054] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:16 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:17.542464 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:17.543105 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:17.549714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.550204 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.550638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.551377 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:17.551834 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:17.552261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:17.697751 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:17.708790 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-721234cc-4ea8-432b-8c59-77817d6c1d39 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1577 microversion: 2.1 time: 0.170536 Aug 31 09:59:17.709903 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 527/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:17 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:18.216439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:18.217082 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:18.223670 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.224160 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.224596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.225353 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.225973 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.226405 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.378289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:18.387039 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-67eea131-e82b-4e23-851d-db23c637da1c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1358 microversion: 2.1 time: 0.175147 Aug 31 09:59:18.387669 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 529/1056] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:18 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:18.735737 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:18.736747 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:18.748674 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.749304 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.749809 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.750601 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:18.751151 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:18.751834 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:18.906615 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:18.915966 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-293615c2-cfd5-49b3-ba6d-dc99dbf43e1f tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1577 microversion: 2.1 time: 0.187746 Aug 31 09:59:18.916559 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 528/1057] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:18 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:19.412016 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:19.414267 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:19.427640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.429298 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.429837 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.430962 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.431830 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.432380 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.683585 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:19.693799 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-bd6b78a3-24e9-4f9c-85ba-4e1a67d6e923 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1547 microversion: 2.1 time: 0.288780 Aug 31 09:59:19.694596 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 530/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:19 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1547 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:19.716715 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:19.717402 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:19.723702 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.724200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.724639 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.725922 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.726380 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.726810 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.897968 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:19.906546 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-ab082ebb-a188-451d-bc57-fdda339ddd9f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1547 microversion: 2.1 time: 0.193449 Aug 31 09:59:19.907057 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 529/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:19 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1547 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:19.935531 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-68900507-f378-46f7-968c-042f0236ffd1 req-7d42464a-da12-4051-8e54-620b91af5f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67ac26dc-0a69-4f0d-9d00-5f35ddc03871", "name": "network-vif-deleted", "tag": "4bc08194-a758-4e1a-9082-fc97cf1c95fb"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:19.940591 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:19.943663 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:19.946923 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-68900507-f378-46f7-968c-042f0236ffd1 req-7d42464a-da12-4051-8e54-620b91af5f0e service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.947442 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-68900507-f378-46f7-968c-042f0236ffd1 req-7d42464a-da12-4051-8e54-620b91af5f0e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.947999 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-68900507-f378-46f7-968c-042f0236ffd1 req-7d42464a-da12-4051-8e54-620b91af5f0e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.955163 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.955672 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.956106 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.956818 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.957966 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.958440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.960922 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-68900507-f378-46f7-968c-042f0236ffd1 req-7d42464a-da12-4051-8e54-620b91af5f0e service nova] Creating event network-vif-deleted:4bc08194-a758-4e1a-9082-fc97cf1c95fb for instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 on hv-cinder-83754 Aug 31 09:59:19.966151 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-68900507-f378-46f7-968c-042f0236ffd1 req-7d42464a-da12-4051-8e54-620b91af5f0e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034592 Aug 31 09:59:19.966766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 531/1060] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:59:19.976103 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:19.981274 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:19.982162 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Searching by: {'deleted': False, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e'} {{(pid=132571) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 09:59:19.990037 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.990518 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.992026 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:19.992799 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:19.993267 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:19.993698 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.040049 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893e06c5ea99497fae2847399b7a1a3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1c2adbca494a53a24033b674c2762c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:20.056679 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-24171853-8c6d-4a13-8736-b8081c2a5cfa tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 200 len: 1392 microversion: 2.1 time: 0.119481 Aug 31 09:59:20.058125 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 530/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:19 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 1392 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:20.101616 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.multi_cell_list [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132571) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 09:59:20.205849 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d84ced86-94af-42b5-86bd-26e4afd2d1a9 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.234471 Aug 31 09:59:20.206137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 532/1062] 10.222.0.36 () {58 vars in 1125 bytes} [Wed Aug 31 09:59:19 2022] GET /compute/v2.1/servers => generated 342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:20.218348 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:20.218974 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:20.226145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.226937 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.227684 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.228419 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:20.228873 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:20.229494 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:20.432292 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:20.452075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-536e8e1a-e831-4f94-9f60-4179a40f5762 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1547 microversion: 2.1 time: 0.237031 Aug 31 09:59:20.453078 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 531/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:20 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1547 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:21.081619 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:21.083073 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 67ac26dc-0a69-4f0d-9d00-5f35ddc03871] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:21.091851 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.092344 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.092780 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.093523 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.093978 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.094440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.110435 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] HTTP exception thrown: Instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 could not be found. Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Request method failure captured: Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 HTTP/1.1 Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy8Ir8ZylJRAXm4qtYFtPlnT4xr6o9k9azhjHgJN4LC__98UntzAqsCKzy7uxpctYSz7duNSOt1295SVz_YIGr2X09ZKXe0oGZnzjFmXpbSAN5I-4N4fq7Viwt2kvYQ3WvttHC4FOgpG0fM7KFKCz0l1ki4NJBVyFJ2wAcIOqMFuHbU Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:59:21.112158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 893e06c5ea99497fae2847399b7a1a3c Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 could not be found. Aug 31 09:59:21.113725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '67ac26dc-0a69-4f0d-9d00-5f35ddc03871'} Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 could not be found. Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:21.114525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 could not be found. Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 could not be found. Aug 31 09:59:21.115853 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.117728 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Returning 404 to user: Instance 67ac26dc-0a69-4f0d-9d00-5f35ddc03871 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:21.117728 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e27e9489-c966-4c05-af47-87398ec8f37d tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871" status: 404 len: 111 microversion: 2.1 time: 0.036128 Aug 31 09:59:21.117728 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 533/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:21 2022] GET /compute/v2.1/servers/67ac26dc-0a69-4f0d-9d00-5f35ddc03871 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:21.615170 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:21.616126 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:21.624092 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.624576 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.625003 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.625691 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.626130 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.626540 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.641844 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] HTTP exception thrown: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Request method failure captured: Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: DELETE /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 HTTP/1.1 Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDy8Ir8ZylJRAXm4qtYFtPlnT4xr6o9k9azhjHgJN4LC__98UntzAqsCKzy7uxpctYSz7duNSOt1295SVz_YIGr2X09ZKXe0oGZnzjFmXpbSAN5I-4N4fq7Viwt2kvYQ3WvttHC4FOgpG0fM7KFKCz0l1ki4NJBVyFJ2wAcIOqMFuHbU Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 09:59:21.643891 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: 893e06c5ea99497fae2847399b7a1a3c Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.646335 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': '468a13bb-2c16-4395-8ce5-afa5895c6111'} Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:21.648368 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.650269 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.651959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Returning 404 to user: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:21.651959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9c440d1d-2377-4bc6-bb31-f89618024ccc tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "DELETE /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 404 len: 111 microversion: 2.1 time: 0.033910 Aug 31 09:59:21.651959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 532/1065] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 09:59:21 2022] DELETE /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 09:59:21.655453 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:21.656053 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] [instance: 468a13bb-2c16-4395-8ce5-afa5895c6111] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:21.662220 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.662772 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.663228 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.663928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:21.664376 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:21.664796 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:21.678612 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.wsgi [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] HTTP exception thrown: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Request method failure captured: Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: request: GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 HTTP/1.1 Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept: application/json Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Accept-Encoding: identity Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Connection: close Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Length: 0 Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Content-Type: application/json Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Host: 10.222.0.36 Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Openstack-System-Scope: None Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: User-Agent: python-urllib3/1.26.12 Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Auth-Token: gAAAAABjDy8Ir8ZylJRAXm4qtYFtPlnT4xr6o9k9azhjHgJN4LC__98UntzAqsCKzy7uxpctYSz7duNSOt1295SVz_YIGr2X09ZKXe0oGZnzjFmXpbSAN5I-4N4fq7Viwt2kvYQ3WvttHC4FOgpG0fM7KFKCz0l1ki4NJBVyFJ2wAcIOqMFuHbU Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Id: None Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Domain-Name: None Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Identity-Status: Confirmed Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Is-Admin-Project: True Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Id: default Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Domain-Name: Default Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Project-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Role: reader,member Aug 31 09:59:21.680451 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Roles: reader,member Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/9f1c2adbca494a53a24033b674c2762c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Id: 9f1c2adbca494a53a24033b674c2762c Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-Tenant-Name: tempest-TestVolumeBootPattern-1976756673 Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Id: default Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Domain-Name: Default Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Id: 893e06c5ea99497fae2847399b7a1a3c Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: X-User-Name: tempest-TestVolumeBootPattern-1976756673-project Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: method: > Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: exception: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.682472 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: action_args: {'id': '468a13bb-2c16-4395-8ce5-afa5895c6111'} Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 09:59:21.683516 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. Aug 31 09:59:21.684933 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: ERROR nova.api.openstack.wsgi Aug 31 09:59:21.686157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Returning 404 to user: Instance 468a13bb-2c16-4395-8ce5-afa5895c6111 could not be found. {{(pid=132571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 09:59:21.686157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-f4610f29-79d2-42c3-ac11-8e5888407976 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111" status: 404 len: 111 microversion: 2.1 time: 0.030157 Aug 31 09:59:21.686157 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 534/1066] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:21 2022] GET /compute/v2.1/servers/468a13bb-2c16-4395-8ce5-afa5895c6111 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 09:59:22.145854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-97977412-c017-4806-8002-516c0d1ab9ba tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ba9acec-db3d-4656-8ab6-a0ed39c7c364"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:22.149121 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-97977412-c017-4806-8002-516c0d1ab9ba tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:22.155203 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-97977412-c017-4806-8002-516c0d1ab9ba tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:22.155690 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-97977412-c017-4806-8002-516c0d1ab9ba tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:22.156123 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-97977412-c017-4806-8002-516c0d1ab9ba tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:22.156825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-97977412-c017-4806-8002-516c0d1ab9ba tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:22.157275 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-97977412-c017-4806-8002-516c0d1ab9ba tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:22.157728 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-97977412-c017-4806-8002-516c0d1ab9ba tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:22.457941 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-97977412-c017-4806-8002-516c0d1ab9ba tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "POST /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315969 Aug 31 09:59:22.458818 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 533/1067] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Aug 31 09:59:22 2022] POST /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:23.010674 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-fa7f1450-6e88-417f-8bf7-5c684d5a82d5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] Calling method '.version_select at 0x7f9462b3a940>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:23.032545 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-fa7f1450-6e88-417f-8bf7-5c684d5a82d5 tempest-TestVolumeBootPattern-1976756673 tempest-TestVolumeBootPattern-1976756673-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-790377107" status: 202 len: 0 microversion: 2.1 time: 0.026634 Aug 31 09:59:23.033046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 535/1068] 10.222.0.36 () {58 vars in 1260 bytes} [Wed Aug 31 09:59:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-790377107 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:59:30.163459 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:30.164184 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:30.168982 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:30.177228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.177789 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.179779 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.180748 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:30.181517 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:30.181955 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:30.403502 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:30.416333 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2c1c7c01-0dde-42e3-b0fb-37c1220a0297 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1593 microversion: 2.1 time: 0.259192 Aug 31 09:59:30.417565 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 534/1069] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:30 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1593 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:32.690427 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell0:SELECT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:32.691217 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:32.695385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-a52fcf73-121a-4dad-9d57-689638ca3e6d req-64e7eb03-b8e1-4ee4-a72e-e553a11f514d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e4458d-e6f9-4340-9b31-4e2e67eb8acb", "tag": "389cd736-ae81-48e5-b1bb-5b148dd4f035"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:32.701239 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:32.708318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-a52fcf73-121a-4dad-9d57-689638ca3e6d req-64e7eb03-b8e1-4ee4-a72e-e553a11f514d service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:32.708797 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-a52fcf73-121a-4dad-9d57-689638ca3e6d req-64e7eb03-b8e1-4ee4-a72e-e553a11f514d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:32.709219 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-a52fcf73-121a-4dad-9d57-689638ca3e6d req-64e7eb03-b8e1-4ee4-a72e-e553a11f514d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:32.722372 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-a52fcf73-121a-4dad-9d57-689638ca3e6d req-64e7eb03-b8e1-4ee4-a72e-e553a11f514d service nova] Creating event network-changed:389cd736-ae81-48e5-b1bb-5b148dd4f035 for instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb on hv-cinder-83754 Aug 31 09:59:32.728950 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-a52fcf73-121a-4dad-9d57-689638ca3e6d req-64e7eb03-b8e1-4ee4-a72e-e553a11f514d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039636 Aug 31 09:59:32.729485 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 536/1070] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 09:59:33.798660 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1791400089"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:33.799572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:33.807228 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:33.807821 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:33.808325 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:33.809097 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:33.809638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:33.810331 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:33.986367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.network.security_group_api [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Adding security group 4e26f085-860e-466f-b136-db0b77e4ea25 to port 389cd736-ae81-48e5-b1bb-5b148dd4f035 Aug 31 09:59:34.333706 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9c80380a-3ea9-4b1c-9f48-bd76d2028138 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "POST /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/action" status: 202 len: 0 microversion: 2.1 time: 0.540184 Aug 31 09:59:34.334397 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 535/1071] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:59:33 2022] POST /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:59:34.342483 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:34.343186 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:34.350852 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:34.352334 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:34.353130 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:34.354056 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:34.354508 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:34.355144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:34.522131 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:34.530714 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-dc9bc3b3-b625-41f2-8e3f-ff4dbd5d4d66 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1759 microversion: 2.1 time: 0.191926 Aug 31 09:59:34.535533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 536/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:34 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 09:59:34.573817 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-ee55edb2-9b66-4dd4-a58f-ebc3d62aac4c req-9d0a58e1-7607-4012-a54e-124d3ac2a07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e4458d-e6f9-4340-9b31-4e2e67eb8acb", "tag": "389cd736-ae81-48e5-b1bb-5b148dd4f035"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:34.583973 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-ee55edb2-9b66-4dd4-a58f-ebc3d62aac4c req-9d0a58e1-7607-4012-a54e-124d3ac2a07a service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:34.585117 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-ee55edb2-9b66-4dd4-a58f-ebc3d62aac4c req-9d0a58e1-7607-4012-a54e-124d3ac2a07a service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:34.585493 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-ee55edb2-9b66-4dd4-a58f-ebc3d62aac4c req-9d0a58e1-7607-4012-a54e-124d3ac2a07a service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:34.597652 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-ee55edb2-9b66-4dd4-a58f-ebc3d62aac4c req-9d0a58e1-7607-4012-a54e-124d3ac2a07a service nova] Creating event network-changed:389cd736-ae81-48e5-b1bb-5b148dd4f035 for instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb on hv-cinder-83754 Aug 31 09:59:34.604831 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-ee55edb2-9b66-4dd4-a58f-ebc3d62aac4c req-9d0a58e1-7607-4012-a54e-124d3ac2a07a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266348 Aug 31 09:59:34.605444 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 537/1073] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 09:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 09:59:57.152011 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-a8f119df-86ba-4cf7-9777-5e90442b272f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 09:59:57.154288 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-a8f119df-86ba-4cf7-9777-5e90442b272f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:57.156673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=5 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:57.157322 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:57.163785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8f119df-86ba-4cf7-9777-5e90442b272f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.164267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8f119df-86ba-4cf7-9777-5e90442b272f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.164724 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8f119df-86ba-4cf7-9777-5e90442b272f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.165404 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8f119df-86ba-4cf7-9777-5e90442b272f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.165878 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8f119df-86ba-4cf7-9777-5e90442b272f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.166271 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-a8f119df-86ba-4cf7-9777-5e90442b272f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.237473 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-a8f119df-86ba-4cf7-9777-5e90442b272f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "POST /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/action" status: 202 len: 0 microversion: 2.1 time: 0.089181 Aug 31 09:59:57.238111 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 537/1074] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 09:59:57 2022] POST /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 09:59:57.244697 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=3 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:57.245233 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=4 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:57.249489 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:57.250205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:57.257482 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.258012 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.258430 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.259163 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:57.259696 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:57.260133 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:57.496288 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:57.504947 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-1e534fc9-bc49-466b-a000-d2bf19848ab3 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1751 microversion: 2.1 time: 0.262011 Aug 31 09:59:57.505543 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 538/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:57 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:58.528017 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:58.528728 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:58.535171 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:58.535709 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:58.536144 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:58.536876 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:58.538019 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:58.538387 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:58.701712 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:58.710676 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-c061813d-012a-46ac-a14f-247cabf9227f tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.187559 Aug 31 09:59:58.711268 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 538/1076] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:58 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 09:59:59.732233 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 09:59:59.732845 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 09:59:59.743433 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:59.744046 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:59.744801 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:59.746511 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 09:59:59.749680 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 09:59:59.750127 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 09:59:59.908163 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 09:59:59.917233 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a57b564e-d93d-4b32-9f1d-285fe944a994 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.188764 Aug 31 09:59:59.917825 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 539/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 09:59:59 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:00.940500 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:00.941133 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:00.952874 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:00.953677 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:00.954361 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:00.955091 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:00.955577 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:00.956010 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:01.115798 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:01.124695 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-137813d1-c771-4ce2-86b1-83b489456056 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.188191 Aug 31 10:00:01.125279 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 539/1078] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:00 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:02.148440 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:02.149540 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:02.161439 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:02.161935 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:02.162568 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:02.163794 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:02.164255 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:02.164683 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:02.338525 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:02.346792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9d4112ad-e5d9-4b3a-924b-1bbaaf9a3b55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.204502 Aug 31 10:00:02.347407 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 540/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:02 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:03.369008 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:03.369782 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:03.375788 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:03.376274 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:03.376740 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:03.377432 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:03.377885 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:03.378312 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:03.523534 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:03.531622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4f25d911-f62a-41ae-b125-82b56c0a0e38 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.167133 Aug 31 10:00:03.532182 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 540/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:03 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:04.553092 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:04.553714 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:04.560443 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:04.560930 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:04.561372 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:04.562081 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:04.562538 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:04.562972 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:04.732602 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:04.743392 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ef5b469c-58f0-4a9f-96f5-695711f4328d tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.194042 Aug 31 10:00:04.744085 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 541/1081] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:04 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:05.765995 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:05.766813 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:05.774029 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:05.774505 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:05.774933 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:05.775656 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:05.776101 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:05.776520 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:05.929285 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:05.937693 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9ff10445-a1d1-42cc-98cc-15e4dfaa4d9b tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.175675 Aug 31 10:00:05.938282 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 541/1082] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:05 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:06.960814 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:06.961425 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:06.967894 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:06.968384 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:06.968802 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:06.969491 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:06.970055 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:06.970364 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:07.128182 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:07.137938 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-02c49699-f0e0-4e9c-ad19-07fd957ca5fd tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.181431 Aug 31 10:00:07.138526 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 542/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:06 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:08.161341 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:08.162169 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:08.168879 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:08.169358 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:08.169785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:08.170484 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:08.170928 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:08.171384 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:08.332267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:08.343283 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-bac9a613-f473-487e-a11a-3e80d3592914 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.186142 Aug 31 10:00:08.343883 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 542/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:08 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:09.369890 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:09.370816 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:09.377686 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:09.378236 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:09.378640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:09.379386 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:09.379847 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:09.380271 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:09.545074 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:09.554304 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3c595e44-9a66-4309-a3ac-ed049389b082 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1756 microversion: 2.1 time: 0.189495 Aug 31 10:00:09.554871 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 543/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:09 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:10.577020 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:10.577622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:10.585052 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:10.585537 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:10.586096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:10.587000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:10.587516 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:10.587919 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:10.745366 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:10.754047 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-3682cff0-ca6c-4211-b6af-60d8713b44b4 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1759 microversion: 2.1 time: 0.180782 Aug 31 10:00:10.754648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 543/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:10 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1759 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:22.910635 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:22.911266 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:22.913200 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=12 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:22.913855 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=36 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:22.920006 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:22.920497 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:22.920931 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:22.921627 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:22.922087 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:22.922510 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:22.945794 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lazy-loading 'flavor' on Instance uuid c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:00:23.018988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d0300b0a-405e-44b2-96fa-119f26f5e92a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "POST /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4/action" status: 202 len: 0 microversion: 2.1 time: 0.112302 Aug 31 10:00:23.019613 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 544/1087] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 10:00:22 2022] POST /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:00:23.028089 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:23.028787 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:23.031535 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=14 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:23.032222 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:23.037666 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:23.038161 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:23.038592 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:23.039396 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:23.039857 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:23.040278 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:23.184484 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:23.192493 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-57751a6e-f3d7-4fa0-b706-49d6604d045f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.168311 Aug 31 10:00:23.193071 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 544/1088] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:23 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:24.214431 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:24.215136 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:24.221201 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:24.221676 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:24.222100 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:24.222778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:24.223259 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:24.223677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:24.364103 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:24.372608 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4bd6c268-d483-43db-b261-91f01d871f33 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.163092 Aug 31 10:00:24.373176 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 545/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:24 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:25.393833 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:25.395033 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:25.402523 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:25.403000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:25.403453 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:25.404145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:25.404591 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:25.405009 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:25.541825 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:25.549822 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-510ed23c-b4db-46d9-90af-93f5a7cd8815 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.159904 Aug 31 10:00:25.550424 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 545/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:25 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:26.572147 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:26.573111 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:26.579742 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:26.580230 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:26.580665 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:26.581373 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:26.581833 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:26.582254 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:26.725531 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:26.734205 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b6b74219-a596-4037-98c3-f1859b2f799a tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.165917 Aug 31 10:00:26.734784 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 546/1091] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:26 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:27.756019 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:27.756622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:27.763548 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:27.764019 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:27.764447 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:27.765124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:27.765568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:27.765980 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:27.904277 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:27.911960 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-fd5a9e0a-0ae0-4462-a279-14171ad06fea tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.159798 Aug 31 10:00:27.912555 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 546/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:27 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:28.934453 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:28.935382 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:28.941862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:28.942417 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:28.942780 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:28.943792 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:28.943972 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:28.944402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:29.108282 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:29.123270 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-20e5cf97-c9e2-4f16-b1f5-df90fbb8be1c tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.193534 Aug 31 10:00:29.124255 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 547/1093] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:28 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:30.146513 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:30.147193 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:30.154064 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:30.154561 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:30.154998 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:30.155750 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:30.156210 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:30.156638 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:30.318106 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:30.327003 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-1c3dd6fb-279a-431f-8ff2-64d09aa56e3e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.185496 Aug 31 10:00:30.327543 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 547/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:30 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:31.350108 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:31.350667 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:31.358152 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.358638 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.359077 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:31.359811 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:31.360269 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:31.360696 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:31.509199 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:31.517899 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-b1177e75-2fba-47d4-8e0d-73d94107b461 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.171727 Aug 31 10:00:31.518489 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 548/1095] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:31 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:00:32.540106 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:32.540769 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:32.547553 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:32.548042 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:32.548479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:32.549194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:32.549651 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:32.550080 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:32.686567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:32.694357 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0eb0f802-7ae0-4a16-b783-65230f956f35 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.158318 Aug 31 10:00:32.694927 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 548/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:32 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:33.715870 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:33.716494 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:33.723206 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:33.723705 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:33.724137 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:33.724845 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:33.725300 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:33.725734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:33.948197 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:33.956949 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-46d36154-13cb-4d17-9fd9-0407835c6f52 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.244925 Aug 31 10:00:33.957461 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 549/1097] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:33 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:34.980594 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:34.981302 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:34.988591 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:34.989117 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:34.989560 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:34.990265 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:34.990717 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:34.991152 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:35.141440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:35.149633 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9a772716-820e-4555-bf4f-4f3cfe9ceb47 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.173887 Aug 31 10:00:35.150224 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 549/1098] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:34 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:36.172219 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:36.173476 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:36.175573 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 10:00:36.175718 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: Wed Aug 31 10:00:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 (ip 10.222.0.36) !!! Aug 31 10:00:36.183029 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:36.183547 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:36.183988 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:36.184702 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:36.185155 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:36.185580 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:36.344429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:36.353765 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3362d115-3256-46ef-a4cb-3ab3cdf861ef tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.185117 Aug 31 10:00:36.354971 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 550/1099] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:36 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:37.380673 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:37.381298 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:37.388518 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.389000 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.389428 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.390122 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.390567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.390982 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.527360 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:37.535732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-0af84a42-9c85-41c0-a364-47153e0f4621 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1510 microversion: 2.1 time: 0.158913 Aug 31 10:00:37.536527 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 550/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:37 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:37.565015 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:37.565753 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:37.572612 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.573575 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.573928 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.574640 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.575098 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.575565 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.611489 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132571) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 10:00:37.683463 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-59bb61ae-7ce4-4aec-9be3-d6c680cdddb4 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "POST /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4/action" status: 202 len: 0 microversion: 2.1 time: 0.122428 Aug 31 10:00:37.684338 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 551/1101] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 10:00:37 2022] POST /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:00:37.692968 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:37.694035 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:37.699866 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.700354 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.700791 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.701487 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:37.701939 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:37.702379 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:37.875663 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:37.883641 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-7abf1fab-57da-4a0a-8acc-b31d816944ae tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1518 microversion: 2.1 time: 0.194672 Aug 31 10:00:37.884257 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 551/1102] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:37 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:38.905816 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:38.906385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:38.912987 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:38.913495 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:38.914243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:38.915202 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:38.915598 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:38.916968 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:39.064017 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:39.072448 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-9228b1d8-374c-4255-8656-989663665d7e tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1520 microversion: 2.1 time: 0.171770 Aug 31 10:00:39.073346 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 552/1103] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:38 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:40.100862 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:40.101603 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:40.112065 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:40.112589 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:40.113026 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:40.114176 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:40.114835 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:40.115505 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:40.162261 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-1b54a422-7d88-4dce-ac9a-3be1b6483672 req-f17d1d43-c812-4988-b167-3c81b1ed83e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4", "name": "network-vif-unplugged", "status": "completed", "tag": "b7e2db10-953b-43a4-928b-97b8843ac6a8"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:40.173473 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-1b54a422-7d88-4dce-ac9a-3be1b6483672 req-f17d1d43-c812-4988-b167-3c81b1ed83e7 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:40.174112 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-1b54a422-7d88-4dce-ac9a-3be1b6483672 req-f17d1d43-c812-4988-b167-3c81b1ed83e7 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:40.174549 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-1b54a422-7d88-4dce-ac9a-3be1b6483672 req-f17d1d43-c812-4988-b167-3c81b1ed83e7 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:40.187585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-1b54a422-7d88-4dce-ac9a-3be1b6483672 req-f17d1d43-c812-4988-b167-3c81b1ed83e7 service nova] Creating event network-vif-unplugged:b7e2db10-953b-43a4-928b-97b8843ac6a8 for instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 on hv-cinder-83754 Aug 31 10:00:40.193176 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-1b54a422-7d88-4dce-ac9a-3be1b6483672 req-f17d1d43-c812-4988-b167-3c81b1ed83e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131837 Aug 31 10:00:40.193928 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 552/1104] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:40.326666 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:40.334539 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-87efe7b2-67aa-4672-bb25-bebc0e5ee84b tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1576 microversion: 2.1 time: 0.237531 Aug 31 10:00:40.339359 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 553/1105] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:40 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:41.357474 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:41.358059 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:41.364443 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.364914 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.365341 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.366030 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:41.366479 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:41.367189 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:41.513853 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:41.522115 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-6d51e32d-ee0d-45b9-a482-7ba45eb01963 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1576 microversion: 2.1 time: 0.169900 Aug 31 10:00:41.522707 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 553/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:41 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:42.545658 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:42.546317 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:42.552731 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:42.553243 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:42.553659 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:42.554385 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:42.554839 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:42.555313 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:42.689212 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:42.696955 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8aa09aaf-a37b-46e9-a787-89f6e591ae05 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1576 microversion: 2.1 time: 0.156736 Aug 31 10:00:42.697731 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 554/1107] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:42 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:43.719019 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:43.719661 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:43.726247 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.726737 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.727203 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:43.727906 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:43.728881 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:43.729308 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:43.875583 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:43.884016 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-032e265c-b7af-411e-beb4-88dd34d2f9a8 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1576 microversion: 2.1 time: 0.168773 Aug 31 10:00:43.884654 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 554/1108] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:43 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:44.264881 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1791400089"}} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:44.265469 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:44.272148 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:44.272632 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:44.273062 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:44.273748 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:44.274195 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:44.274616 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:44.402660 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.network.security_group_api [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Removing security group 4e26f085-860e-466f-b136-db0b77e4ea25 from port 389cd736-ae81-48e5-b1bb-5b148dd4f035 Aug 31 10:00:44.733725 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-8182e0b9-3da6-43c2-ae7d-faad421caa05 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "POST /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/action" status: 202 len: 0 microversion: 2.1 time: 0.472692 Aug 31 10:00:44.738899 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 555/1109] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Aug 31 10:00:44 2022] POST /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 10:00:44.749718 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-6973d4bf-7cd2-41a1-a1c5-d4a3fe6aea84 req-f087ff85-a99b-47b7-a61f-66c76127adac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e4458d-e6f9-4340-9b31-4e2e67eb8acb", "tag": "389cd736-ae81-48e5-b1bb-5b148dd4f035"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:44.770336 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-6973d4bf-7cd2-41a1-a1c5-d4a3fe6aea84 req-f087ff85-a99b-47b7-a61f-66c76127adac service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:44.771391 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-6973d4bf-7cd2-41a1-a1c5-d4a3fe6aea84 req-f087ff85-a99b-47b7-a61f-66c76127adac service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:44.772174 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-6973d4bf-7cd2-41a1-a1c5-d4a3fe6aea84 req-f087ff85-a99b-47b7-a61f-66c76127adac service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:44.796959 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-6973d4bf-7cd2-41a1-a1c5-d4a3fe6aea84 req-f087ff85-a99b-47b7-a61f-66c76127adac service nova] Creating event network-changed:389cd736-ae81-48e5-b1bb-5b148dd4f035 for instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb on hv-cinder-83754 Aug 31 10:00:44.806187 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-6973d4bf-7cd2-41a1-a1c5-d4a3fe6aea84 req-f087ff85-a99b-47b7-a61f-66c76127adac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063427 Aug 31 10:00:44.807697 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 555/1110] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:44.907535 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:44.908159 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:44.917509 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:44.918019 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:44.918446 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:44.919583 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:44.919926 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:44.920366 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:45.184083 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:45.192880 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-4085a440-15bf-4a06-801d-e36ca5c095ac tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1576 microversion: 2.1 time: 0.289570 Aug 31 10:00:45.193486 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 556/1111] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:44 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1576 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:45.912506 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:45.913457 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:45.913639 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-9a53820e-04ea-4cc5-a918-6ffe0859cbed req-c582909c-1976-433a-8df3-6b1072e8863d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4e4458d-e6f9-4340-9b31-4e2e67eb8acb", "tag": "389cd736-ae81-48e5-b1bb-5b148dd4f035"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:45.920648 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:45.921283 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:45.921962 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:45.923429 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:45.923966 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:45.924147 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-9a53820e-04ea-4cc5-a918-6ffe0859cbed req-c582909c-1976-433a-8df3-6b1072e8863d service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:45.924478 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:45.924594 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-9a53820e-04ea-4cc5-a918-6ffe0859cbed req-c582909c-1976-433a-8df3-6b1072e8863d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:45.924924 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-9a53820e-04ea-4cc5-a918-6ffe0859cbed req-c582909c-1976-433a-8df3-6b1072e8863d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:45.938691 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-9a53820e-04ea-4cc5-a918-6ffe0859cbed req-c582909c-1976-433a-8df3-6b1072e8863d service nova] Creating event network-changed:389cd736-ae81-48e5-b1bb-5b148dd4f035 for instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb on hv-cinder-83754 Aug 31 10:00:45.945474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-9a53820e-04ea-4cc5-a918-6ffe0859cbed req-c582909c-1976-433a-8df3-6b1072e8863d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034473 Aug 31 10:00:45.945474 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 557/1112] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:46.038328 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.objects.instance [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lazy-loading 'services' on Instance uuid c4e4458d-e6f9-4340-9b31-4e2e67eb8acb {{(pid=132570) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:00:46.138608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-9fef9652-7437-49c2-ae45-f18e1fdfdf10 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments/8ba9acec-db3d-4656-8ab6-a0ed39c7c364" status: 202 len: 0 microversion: 2.1 time: 0.230828 Aug 31 10:00:46.139240 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 556/1113] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 10:00:45 2022] DELETE /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments/8ba9acec-db3d-4656-8ab6-a0ed39c7c364 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:00:46.148927 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-e0b392a7-208d-4c72-9d24-a53e5f0bca04 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:46.151691 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-e0b392a7-208d-4c72-9d24-a53e5f0bca04 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:46.158162 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0b392a7-208d-4c72-9d24-a53e5f0bca04 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:46.158740 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0b392a7-208d-4c72-9d24-a53e5f0bca04 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:46.159291 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0b392a7-208d-4c72-9d24-a53e5f0bca04 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:46.160110 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0b392a7-208d-4c72-9d24-a53e5f0bca04 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:46.160644 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0b392a7-208d-4c72-9d24-a53e5f0bca04 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:46.161142 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-e0b392a7-208d-4c72-9d24-a53e5f0bca04 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:46.180821 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:46.198797 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-e0b392a7-208d-4c72-9d24-a53e5f0bca04 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054713 Aug 31 10:00:46.199414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 558/1114] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 10:00:46 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:46.227851 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:46.229145 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:46.236089 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:46.236579 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:46.237008 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:46.237703 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:46.238148 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:46.238567 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:46.390120 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:46.397984 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4f8c275b-7a35-4955-8aa4-667303a38567 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1576 microversion: 2.1 time: 0.174588 Aug 31 10:00:46.398556 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 557/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:46 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:47.217273 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-053bdbb0-78a4-48bc-8005-b8185f70c8ed tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:47.220887 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-053bdbb0-78a4-48bc-8005-b8185f70c8ed tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:47.235761 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-053bdbb0-78a4-48bc-8005-b8185f70c8ed tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:47.236626 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-053bdbb0-78a4-48bc-8005-b8185f70c8ed tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:47.237322 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-053bdbb0-78a4-48bc-8005-b8185f70c8ed tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:47.238778 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-053bdbb0-78a4-48bc-8005-b8185f70c8ed tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:47.241005 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-053bdbb0-78a4-48bc-8005-b8185f70c8ed tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:47.241468 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-053bdbb0-78a4-48bc-8005-b8185f70c8ed tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:47.288488 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-053bdbb0-78a4-48bc-8005-b8185f70c8ed tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079787 Aug 31 10:00:47.290275 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 559/1116] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 10:00:47 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:47.419511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:47.420142 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:47.426521 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:47.426931 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:47.427640 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:47.428340 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:47.428801 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:47.429225 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:47.565008 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:47.573463 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-2c8f7a66-ac2c-4e96-89a9-7ae75382df7d tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1576 microversion: 2.1 time: 0.158092 Aug 31 10:00:47.574041 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 558/1117] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:47 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:48.304121 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-256c7d73-f125-4a20-a777-7b475d477a40 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:48.306289 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-256c7d73-f125-4a20-a777-7b475d477a40 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:48.313636 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-256c7d73-f125-4a20-a777-7b475d477a40 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:48.314127 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-256c7d73-f125-4a20-a777-7b475d477a40 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:48.314566 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-256c7d73-f125-4a20-a777-7b475d477a40 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:48.315315 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-256c7d73-f125-4a20-a777-7b475d477a40 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:48.315809 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-256c7d73-f125-4a20-a777-7b475d477a40 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:48.316239 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-256c7d73-f125-4a20-a777-7b475d477a40 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:48.348272 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-256c7d73-f125-4a20-a777-7b475d477a40 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048208 Aug 31 10:00:48.348861 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 560/1118] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Aug 31 10:00:48 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 10:00:48.360548 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:48.361378 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:48.371524 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:48.372188 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:48.372903 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:48.374136 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:48.374732 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:48.375434 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:48.485585 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] HTTP exception thrown: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb is not attached to volume 8ba9acec-db3d-4656-8ab6-a0ed39c7c364 Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Request method failure captured: Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: DELETE /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments/8ba9acec-db3d-4656-8ab6-a0ed39c7c364 HTTP/1.1 Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDzDNlFMGqUioX0weKemdKiD4PbGZrkZ2o_SFBk_8e6TSL9UgfrQxitQ3HKt7TkWWosxHAfClbuKUj8XhyHDgo9AqRptfmDCzKggKVyAv_LkDvpRVkNH-YLbte1nRwPGnlkgOVF0VIHvTpkUIWetKSYbrPDIBRnaatq17UuMkTVFah44 Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 3ad415e35f8746ff86bd0d4f96c3ca9e Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-TestMinimumBasicScenario-1526012623 Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 10:00:48.487981 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3ad415e35f8746ff86bd0d4f96c3ca9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3ad415e35f8746ff86bd0d4f96c3ca9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3ad415e35f8746ff86bd0d4f96c3ca9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3ad415e35f8746ff86bd0d4f96c3ca9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-TestMinimumBasicScenario-1526012623 Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 3ad415e35f8746ff86bd0d4f96c3ca9e Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1526012623 Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-TestMinimumBasicScenario-1526012623-project Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: f6393be1efdd4c12bcf3adbb230c4943 Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-TestMinimumBasicScenario-1526012623-project Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 10:00:48.489701 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb is not attached to volume 8ba9acec-db3d-4656-8ab6-a0ed39c7c364 Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'server_id': 'c4e4458d-e6f9-4340-9b31-4e2e67eb8acb', 'id': '8ba9acec-db3d-4656-8ab6-a0ed39c7c364'} Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8ba9acec-db3d-4656-8ab6-a0ed39c7c364. Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:00:48.490533 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb is not attached to volume 8ba9acec-db3d-4656-8ab6-a0ed39c7c364 Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb is not attached to volume 8ba9acec-db3d-4656-8ab6-a0ed39c7c364 Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:48.492226 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Returning 404 to user: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb is not attached to volume 8ba9acec-db3d-4656-8ab6-a0ed39c7c364 {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:00:48.493327 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-4c7875f1-a9bd-4cd6-9739-406962e36bc2 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments/8ba9acec-db3d-4656-8ab6-a0ed39c7c364" status: 404 len: 154 microversion: 2.1 time: 0.134152 Aug 31 10:00:48.493327 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 559/1119] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Aug 31 10:00:48 2022] DELETE /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb/os-volume_attachments/8ba9acec-db3d-4656-8ab6-a0ed39c7c364 => generated 154 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:00:48.594802 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:48.595771 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:48.602275 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:48.603414 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:48.604695 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:48.605766 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:48.606320 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:48.606987 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:48.761894 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:48.770467 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-ea95689c-914c-4feb-a20b-a7282b5a6ac6 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1563 microversion: 2.1 time: 0.179610 Aug 31 10:00:48.771211 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 561/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:48 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:49.646184 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:49.646753 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:49.657124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:49.657644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:49.658079 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:49.658787 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:49.659276 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:49.659775 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:49.687554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:00:49.702051 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:49.772405 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-afafec1d-1eaf-4d2a-a24f-2543d15c13df tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 204 len: 0 microversion: 2.1 time: 0.129720 Aug 31 10:00:49.772964 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 560/1121] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 10:00:49 2022] DELETE /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:00:49.783461 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:49.784080 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:49.791553 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:49.792208 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:49.792651 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:49.793416 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:49.793954 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:49.794382 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:49.932466 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:49.940898 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-d0326884-3941-4c84-9ef8-62e7ec510108 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1553 microversion: 2.1 time: 0.162093 Aug 31 10:00:49.941391 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 562/1122] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:49 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:50.132676 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-0e6bebca-4307-4dec-82b4-1189f9ae57e5 req-235fd0fb-d506-4df3-a89a-079ef4ee701d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4", "name": "network-vif-plugged", "status": "completed", "tag": "b7e2db10-953b-43a4-928b-97b8843ac6a8"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:50.143393 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-0e6bebca-4307-4dec-82b4-1189f9ae57e5 req-235fd0fb-d506-4df3-a89a-079ef4ee701d service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:50.143965 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-0e6bebca-4307-4dec-82b4-1189f9ae57e5 req-235fd0fb-d506-4df3-a89a-079ef4ee701d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:50.144401 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-0e6bebca-4307-4dec-82b4-1189f9ae57e5 req-235fd0fb-d506-4df3-a89a-079ef4ee701d service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:50.157327 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-0e6bebca-4307-4dec-82b4-1189f9ae57e5 req-235fd0fb-d506-4df3-a89a-079ef4ee701d service nova] Creating event network-vif-plugged:b7e2db10-953b-43a4-928b-97b8843ac6a8 for instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 on hv-cinder-83754 Aug 31 10:00:50.162267 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-0e6bebca-4307-4dec-82b4-1189f9ae57e5 req-235fd0fb-d506-4df3-a89a-079ef4ee701d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033658 Aug 31 10:00:50.162884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 561/1123] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:00:50.962631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:50.963868 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:50.970593 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:50.971086 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:50.971548 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:50.972265 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:50.972721 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:50.973158 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:51.124869 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:51.132774 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2ea4ee88-75e3-435b-bae8-0eb49413da55 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1553 microversion: 2.1 time: 0.174056 Aug 31 10:00:51.133344 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 563/1124] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:50 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:52.155440 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:52.156218 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:52.163460 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:52.163950 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:52.164460 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:52.165096 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:52.165661 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:52.166644 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:52.317471 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6393be1efdd4c12bcf3adbb230c4943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ad415e35f8746ff86bd0d4f96c3ca9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:00:52.332607 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-18cf042e-2fd8-4026-a23c-02cb8d4bf983 tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 200 len: 1553 microversion: 2.1 time: 0.181804 Aug 31 10:00:52.333733 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 562/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:52 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:00:52.599586 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-507c985d-b71a-406f-b21d-37ca753a89c3 req-37b2bea7-d176-49fd-bc59-2893e8de3a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4e4458d-e6f9-4340-9b31-4e2e67eb8acb", "name": "network-vif-deleted", "tag": "389cd736-ae81-48e5-b1bb-5b148dd4f035"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:00:52.612798 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-507c985d-b71a-406f-b21d-37ca753a89c3 req-37b2bea7-d176-49fd-bc59-2893e8de3a60 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:52.613285 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-507c985d-b71a-406f-b21d-37ca753a89c3 req-37b2bea7-d176-49fd-bc59-2893e8de3a60 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:52.613726 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-507c985d-b71a-406f-b21d-37ca753a89c3 req-37b2bea7-d176-49fd-bc59-2893e8de3a60 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:52.628958 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-507c985d-b71a-406f-b21d-37ca753a89c3 req-37b2bea7-d176-49fd-bc59-2893e8de3a60 service nova] Creating event network-vif-deleted:389cd736-ae81-48e5-b1bb-5b148dd4f035 for instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb on hv-cinder-83754 Aug 31 10:00:52.636757 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-507c985d-b71a-406f-b21d-37ca753a89c3 req-37b2bea7-d176-49fd-bc59-2893e8de3a60 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041004 Aug 31 10:00:52.637398 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 564/1126] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 10:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:00:53.370921 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:53.371559 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] [instance: c4e4458d-e6f9-4340-9b31-4e2e67eb8acb] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:00:53.373938 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:53.379279 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:53.379765 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:53.380200 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:53.380889 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:00:53.381339 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:00:53.381760 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:00:53.397319 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] HTTP exception thrown: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb could not be found. Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Request method failure captured: Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb HTTP/1.1 Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDzDNlFMGqUioX0weKemdKiD4PbGZrkZ2o_SFBk_8e6TSL9UgfrQxitQ3HKt7TkWWosxHAfClbuKUj8XhyHDgo9AqRptfmDCzKggKVyAv_LkDvpRVkNH-YLbte1nRwPGnlkgOVF0VIHvTpkUIWetKSYbrPDIBRnaatq17UuMkTVFah44 Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: 3ad415e35f8746ff86bd0d4f96c3ca9e Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-TestMinimumBasicScenario-1526012623 Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 10:00:53.398884 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3ad415e35f8746ff86bd0d4f96c3ca9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3ad415e35f8746ff86bd0d4f96c3ca9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3ad415e35f8746ff86bd0d4f96c3ca9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3ad415e35f8746ff86bd0d4f96c3ca9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-TestMinimumBasicScenario-1526012623 Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: 3ad415e35f8746ff86bd0d4f96c3ca9e Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1526012623 Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-TestMinimumBasicScenario-1526012623-project Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: f6393be1efdd4c12bcf3adbb230c4943 Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-TestMinimumBasicScenario-1526012623-project Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb could not be found. Aug 31 10:00:53.401232 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'c4e4458d-e6f9-4340-9b31-4e2e67eb8acb'} Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb could not be found. Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:00:53.402367 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb could not be found. Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb could not be found. Aug 31 10:00:53.404116 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:00:53.405572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Returning 404 to user: Instance c4e4458d-e6f9-4340-9b31-4e2e67eb8acb could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:00:53.405572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-58d57934-162b-44fc-af90-0cf096ec9f7c tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb" status: 404 len: 111 microversion: 2.1 time: 0.034045 Aug 31 10:00:53.405572 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 563/1127] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:00:53 2022] GET /compute/v2.1/servers/c4e4458d-e6f9-4340-9b31-4e2e67eb8acb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:00:53.410631 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-2a60667e-c677-40b3-b97d-554ecce2efec tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] Calling method '.version_select at 0x7f9462b563a0>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:00:53.417797 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:53.431110 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-2a60667e-c677-40b3-b97d-554ecce2efec tempest-TestMinimumBasicScenario-1526012623 tempest-TestMinimumBasicScenario-1526012623-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1223368833" status: 202 len: 0 microversion: 2.1 time: 0.024590 Aug 31 10:00:53.432077 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 565/1128] 10.222.0.36 () {58 vars in 1272 bytes} [Wed Aug 31 10:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1223368833 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:02:09.504942 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:09.505860 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG dbcounter [-] [132570] Writing DB stats nova_api:SELECT=1 {{(pid=132570) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:09.507357 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_cell1:SELECT=34 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:09.508161 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG dbcounter [-] [132571] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=132571) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:02:09.511511 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:09.512194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:09.512946 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [req-a30766a6-33b3-4c9d-b723-1cd790101e5e req-0f69f28a-cee6-43a4-81b9-fedd722ab95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4", "tag": "b7e2db10-953b-43a4-928b-97b8843ac6a8"}]} {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:09.521050 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:09.521657 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:09.522270 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:09.522996 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:09.523481 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:09.523964 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:09.526275 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-a30766a6-33b3-4c9d-b723-1cd790101e5e req-0f69f28a-cee6-43a4-81b9-fedd722ab95e service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:09.526803 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-a30766a6-33b3-4c9d-b723-1cd790101e5e req-0f69f28a-cee6-43a4-81b9-fedd722ab95e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:09.527203 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [req-a30766a6-33b3-4c9d-b723-1cd790101e5e req-0f69f28a-cee6-43a4-81b9-fedd722ab95e service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:09.539412 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.compute.server_external_events [req-a30766a6-33b3-4c9d-b723-1cd790101e5e req-0f69f28a-cee6-43a4-81b9-fedd722ab95e service nova] Creating event network-changed:b7e2db10-953b-43a4-928b-97b8843ac6a8 for instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 on hv-cinder-83754 Aug 31 10:02:09.544628 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [req-a30766a6-33b3-4c9d-b723-1cd790101e5e req-0f69f28a-cee6-43a4-81b9-fedd722ab95e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039122 Aug 31 10:02:09.545429 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 566/1129] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 10:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:02:09.554785 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Going to try to terminate instance {{(pid=132570) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:02:09.640539 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-27de003c-9c27-40b3-a4c1-edbf46c7123f tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 204 len: 0 microversion: 2.1 time: 0.137370 Aug 31 10:02:09.646506 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 564/1130] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Aug 31 10:02:09 2022] DELETE /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:02:09.651324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:09.652345 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:09.659795 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:09.661079 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:09.661734 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:09.662681 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:09.663318 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:09.663741 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:09.804590 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:09.812450 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-26c7f10b-3259-4316-819a-1fd069d653ce tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.165618 Aug 31 10:02:09.813030 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 567/1131] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:09 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:02:10.834551 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:10.835370 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:10.841864 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:10.842346 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:10.842808 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:10.843528 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:10.843983 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:10.844408 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:10.979837 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.policy [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132570) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:10.987554 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-11e349d4-fdf7-4eb2-8d52-309e9e71d8bf tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1569 microversion: 2.1 time: 0.157373 Aug 31 10:02:10.988124 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 565/1132] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:10 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:12.010677 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:12.011684 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:12.018203 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:12.018692 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:12.019149 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:12.019878 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:12.020363 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:12.020788 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:12.184758 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:12.200692 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-3b7d51b2-b08d-4f0a-b2d1-1f3b79dc43f1 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1451 microversion: 2.1 time: 0.195165 Aug 31 10:02:12.201365 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 568/1133] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:12 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1451 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:02:12.309615 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [req-66640deb-c49b-4729-8972-66e22e35736b req-243b07e8-55c7-4fee-a0d0-756b1f2cdef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4", "name": "network-vif-deleted", "tag": "b7e2db10-953b-43a4-928b-97b8843ac6a8"}]} {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:02:12.320794 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-66640deb-c49b-4729-8972-66e22e35736b req-243b07e8-55c7-4fee-a0d0-756b1f2cdef0 service nova] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:12.321264 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-66640deb-c49b-4729-8972-66e22e35736b req-243b07e8-55c7-4fee-a0d0-756b1f2cdef0 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:12.321791 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [req-66640deb-c49b-4729-8972-66e22e35736b req-243b07e8-55c7-4fee-a0d0-756b1f2cdef0 service nova] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:12.334194 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.compute.server_external_events [req-66640deb-c49b-4729-8972-66e22e35736b req-243b07e8-55c7-4fee-a0d0-756b1f2cdef0 service nova] Creating event network-vif-deleted:b7e2db10-953b-43a4-928b-97b8843ac6a8 for instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 on hv-cinder-83754 Aug 31 10:02:12.339568 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [req-66640deb-c49b-4729-8972-66e22e35736b req-243b07e8-55c7-4fee-a0d0-756b1f2cdef0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Aug 31 10:02:12.340482 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 566/1134] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Aug 31 10:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:02:13.225432 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:13.226235 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.compute.api [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132571) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:13.233191 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:13.233687 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:13.234129 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:13.234832 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:13.235324 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:13.235754 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:13.270936 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:13.271965 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:13.272402 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG oslo_concurrency.lockutils [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:13.272852 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.objects.instance [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lazy-loading 'fault' on Instance uuid c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 {{(pid=132571) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:02:13.315595 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.policy [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4003700359449afb83a7352ff2b326a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e73cfdbb50144b67a614836f73ed5b3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132571) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:02:13.324421 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-a21507a8-5d2c-4d6c-90f8-f6448f4721fc tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 200 len: 1225 microversion: 2.1 time: 0.103568 Aug 31 10:02:13.325049 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 569/1135] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:13 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:02:14.347746 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '>' {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:14.348350 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.compute.api [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] [instance: c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4] Fetching instance by UUID {{(pid=132570) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:02:14.354988 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:14.355503 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:14.355933 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:14.356616 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Acquiring lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:02:14.357064 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:02:14.357483 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG oslo_concurrency.lockutils [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Lock "2892fd19-82dd-46bd-9aca-c75fabb94ea6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132570) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:02:14.374150 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.wsgi [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] HTTP exception thrown: Instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 could not be found. Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Request method failure captured: Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: request: GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 HTTP/1.1 Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept: application/json Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Accept-Encoding: identity Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Connection: close Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Length: 0 Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Content-Type: application/json Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Host: 10.222.0.36 Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: Openstack-System-Scope: None Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: User-Agent: python-urllib3/1.26.12 Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Auth-Token: gAAAAABjDzCMaRCQ1kfo7rkuN14ffRZfiXUpLy1y2hCgtfmA1pmvohAfF64pKDfggRnrhoU1jrLAjIchHaCwTKwemCjniNfEyCUXF1B8uG8klBD6ZJzWMshDJXmPaNk1RE29PqF8YpjdT8NTozral8ITs31vuKHWuVkszxHuB5SBwR0IlAh6ikM Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Id: None Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Domain-Name: None Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Identity-Status: Confirmed Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Is-Admin-Project: True Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Id: default Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Domain-Name: Default Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Id: e73cfdbb50144b67a614836f73ed5b3d Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Project-Name: tempest-TestShelveInstance-1626126085 Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Role: reader,member Aug 31 10:02:14.375797 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Roles: reader,member Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e73cfdbb50144b67a614836f73ed5b3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e73cfdbb50144b67a614836f73ed5b3d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.36:8080", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e73cfdbb50144b67a614836f73ed5b3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e73cfdbb50144b67a614836f73ed5b3d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant: tempest-TestShelveInstance-1626126085 Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Id: e73cfdbb50144b67a614836f73ed5b3d Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-Tenant-Name: tempest-TestShelveInstance-1626126085 Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User: tempest-TestShelveInstance-1626126085-project Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Id: default Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Domain-Name: Default Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Id: f4003700359449afb83a7352ff2b326a Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: X-User-Name: tempest-TestShelveInstance-1626126085-project Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: method: > Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: exception: Instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 could not be found. Aug 31 10:02:14.377608 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: action_args: {'id': 'c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4'} Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: {{(pid=132570) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 could not be found. Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:02:14.378854 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 could not be found. Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 could not be found. Aug 31 10:02:14.381075 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: ERROR nova.api.openstack.wsgi Aug 31 10:02:14.382622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: DEBUG nova.api.openstack.wsgi [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Returning 404 to user: Instance c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 could not be found. {{(pid=132570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:02:14.382622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: INFO nova.api.openstack.requestlog [None req-23c2e4a0-da4f-41f7-9403-aa53199009a7 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4" status: 404 len: 111 microversion: 2.1 time: 0.034210 Aug 31 10:02:14.382622 dv-cinder-837543-8-iscsi devstack@n-api.service[132570]: [pid: 132570|app: 0|req: 567/1136] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Aug 31 10:02:14 2022] GET /compute/v2.1/servers/c3e9f2c1-2c80-494f-903c-2efd5d6a9ae4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:02:14.552001 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: DEBUG nova.api.openstack.wsgi [None req-78492570-0e51-427e-927c-37506484e9c5 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] Calling method '.version_select at 0x7f9462ba3670>' {{(pid=132571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:02:14.575967 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: INFO nova.api.openstack.requestlog [None req-78492570-0e51-427e-927c-37506484e9c5 tempest-TestShelveInstance-1626126085 tempest-TestShelveInstance-1626126085-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1434420611" status: 202 len: 0 microversion: 2.1 time: 0.027770 Aug 31 10:02:14.576909 dv-cinder-837543-8-iscsi devstack@n-api.service[132571]: [pid: 132571|app: 0|req: 570/1137] 10.222.0.36 () {58 vars in 1254 bytes} [Wed Aug 31 10:02:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1434420611 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)